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Abstract 



Elementary vector and tensor analysis concepts are reviewed in a manner that 
proves useful for higher-order tensor analysis of anisotropic media. In addition 
to reviewing basic matrix and vector analysis, the concept of a tensor is cov- 
ered by reviewing and contrasting numerous different definition one might see 
in the literature for the term "tensor." Basic vector and tensor operations are 
provided, as well as some lesser-known operations that are useful in materials 
modeling. Considerable space is devoted to "philosophical" discussions about 
relative merits of the many (often conflicting) tensor notation systems in popu- 



lar use. 
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Preface 

Math and science journals often have extremely restrictive page limits, making it vir- 
tually impossible to present a coherent development of complicated concepts by working 
upward from basic concepts. Furthermore, scholarly journals are intended for the presen- 
tation of new results, so detailed explanations of known results are generally frowned 
upon (even if those results are not well-known or well-understood). Consequently, only 
those readers who are already well-versed in a subject have any hope of effectively read- 
ing the literature to further expand their knowledge. While this situation is good for expe- 
rienced researchers and specialists in a particular field of study, it can be a frustrating 
handicap for less experienced people or people whose expertise lies elsewhere. This book 
serves these individuals by presenting several known theorems or mathematical tech- 
niques that are useful for the analysis material behavior. Most of these theorems are scat- 
tered willy-nilly throughout the literature. Several rarely appear in elementary textbooks. 
Most of the results in this book can be found in advanced textbooks on functional analysis, 
but these books tend to be overly generalized, so the application to specific problems is 
unclear. Advanced mathematics books also tend to use notation that might be unfamiliar to 
the typical research engineer. This book presents derivations of theorems only where they 
help clarify concepts. The range of applicability of theorems is also omitted in certain sit- 
uations. For example, describing the applicability range of a Taylor series expansion 
requires the use of complex variables, which is beyond the scope of this document. Like- 
wise, unless otherwise stated, I will always implicitly presume that functions are "well- 
behaved" enough to permit whatever operations I perform. For example, the act of writing 
df/dx will implicitly tell you that I am assuming that / can be written as a function of x 
and (furthermore) this function is differentiable. In the sense that much of the usual (but 
distracting) mathematical provisos are missing, I consider this document to be a work of 
engineering despite the fact that it is concerned principally with mathematics. While I 
hope this book will be useful to a broader audience of readers, my personal motivation is 
to establish a single bibliographic reference to which I can point from my more stilted and 
terse journal publications. 

Rebecca Brannon, rmbrarm@sandia.gov 

Sandia National Laboratories 
July 11,2003 1:03 prn^ 



"It is important that students bring a certain ragamuffin, barefoot, irreverence 
to their studies; they are not here to worship what is known, but to question it" 

— J. Bronowski [The Ascent of Man] 
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FUNCTIONAL AND STRUCTURED TENSOR 

ANALYSIS FOR ENGINEERS: 

a casual (intuition-based) introduction to vector and 

tensor analysis with reviews of popular notations used in 

contemporary materials modeling 



"Things should be described as simply as possible, 
but no simpler. ' — A. Einstein 



1. Introduction 

RECOMMENDATION: To get immediately into tensor analysis "meat and 
potatoes" go now to page 21 . If, at any time, you become curious about what 
has motivated our style of presentation, then consider coming back to this 
introduction, which just outlines scope and philosophy. 

There's no need to read this book in step-by-step progression. Each section is 
nearly self-contained. If needed, you can backtrack to prerequisite material 
(e.g., unfamiliar terms) by using the index. 

This book reviews tensor algebra and tensor calculus using a notation that proves use- 
ful when extending these basic ideas to higher dimensions. Our intended audience com- 
prises students and professionals (especially those in the material modeling community) 
who have previously learned vector/tensor analysis only at the rudimentary level covered 
in freshman calculus and physics courses. Here in this book, you will find a presentation 
of vector and tensor analysis aimed only at "preparing" you to read properly rigorous text- 
books. You are expected to refer to more classical (rigorous) textbooks to more deeply 
understand each theorem that we present casually in this book. Some people can readily 
master the stilted mathematical language of generalized math theory without ever caring 
about what the equations mean in a physical sense — what a shame. Engineers and other 
"applications-oriented" people often have trouble getting past the supreme generality in 
classical textbooks (where, for example, numbers are complex and sets have arbitrary or 
infinite dimensions). To service these people, we will limit attention to ordinary engineer- 
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ing contexts where numbers are real and the world is three-dimensional. Newcomers to 
engineering tensor analysis will also eventually become exasperated by the apparent dis- 
connects between jargon and definitions among practitioners in the field — some profes- 
sors define the word "tensor" one way while others will define it so dramatically 
differently that the two definitions don't appear to have anything to do with one another. 
In this book we will alert you about these terminology conflicts, and provide you with 
means of converting between notational systems (structures), which are essential skills if 
you wish to effectively read the literature or to communicate with colleagues. 

After presenting basic vector and tensor analysis in the form most useful for ordinary 
three-dimensional real-valued engineering problems, we will add some layers of complex- 
ity that begin to show the path to unified theories without walking too far down it. The 
idea will be to explain that many theorems in higher-dimensional realms have perfect ana- 
logs with the ordinary concepts from 3D. For example, you will learn in this book how to 
obliquely project a vector onto a plane (i.e, find the "shadow" cast by an arrow when you 
hold it up in the late afternoon sun), and we demonstrate in other (separate) work that the 
act of solving viscoplasticity models by a return mapping algorithm is perfectly analogous 
to vector projection. 

Throughout this book, we use the term "ordinary" to refer to the three dimensional 
physical space in which everyday engineering problems occur. The term "abstract" will be 
used later when extending ordinary concepts to higher dimensional spaces, which is the 
principal goal of generalized tensor analysis. Except where otherwise stated, the basis 
{e v e 2 ,e 3 } used for vectors and tensors in this book will be assumed regular (i.e., 
orthonormal and right-handed). Thus, all indicial formulas in this book use what most 
people call rectangular Cartesian components. The abbreviation "RCS" is also frequently 
used to denote "Rectangular Cartesian System." Readers interested in irregular bases can 

find a discussion of Curvilinear coordinates at http: //www. m e .unm. e du/~rmbrann/ 

gobag . htmJ^ (however, that document presumes that the reader is already familiar with the 
notation and basic identities that are covered in this book). 



STRUCTURES and SUPERSTRUCTURES 

If you dislike philosophical discussions, then please skip this section. You may go directly to 
page 21 without loss. 

Tensor analysis arises naturally from the study of linear operators. Though tensor anal- 
ysis is interesting in its own right, engineers learn it because the operators have some 
physical significance. Junior high school children learn about zeroth order tensors when 
they are taught the mathematics of straight lines, and the most important new concept at 
that time is the slope of a line. In freshman calculus, students learn to find local slopes 
(i.e., tangents to curves obtained through differentiation). Freshman students are also 
given a discomforting introduction to first-order tensors when they are told that a vector is 
"something with magnitude and direction". For scientists, these concepts begin to "gel" in 
physics classes (where "useful" vectors such as velocity or electric field are introduced, 
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and vector operations such as the cross-product begin to take on useful meanings). As stu- 
dents progress, eventually their attention focuses on the vector operations themselves. 
Some vector operations (such as the dot product) start with two vectors to produce a sca- 
lar. Other operations (such as the cross product) produce another vector as output. Many 
fundamental vector operations are linear, and the concept of a tensor emerges as naturally 
as the concept of slope emerged when you took junior high algebra. Other vector opera- 
tions are nonlinear, but a "tangent tensor" can be constructed in the same sense that a tan- 
gent to a nonlinear curve can be found by freshman calculus students. 

The functional or operational concept of a tensor deals directly with the physical 
meaning of the tensor as an operation or a transformation. The "book-keeping" for charac- 
terizing the transformation is accomplished through the use of structures. A structure is 
simply a notation or syntax — it is an arrangement of individual constituent "parts" writ- 
ten down on the page following strict "blueprints." For example, a matrix is a structure 
constructed by writing down a collection of numbers in tabular form (usually 3x3, 
3 x 1 , or 1 x 3 arrays for engineering applications). The arrangement of two letters in the 
form y x is a structure that represents raising y to the power x . In computer programing, 
the structure "y A x" is often used to represent the same operation. The notation -^ is a 
structure that symbolically represents the operation of differentiating y with respect to x , 
and this operation is sometimes represented using the alternative structure "y ". All of 
these examples of structures should be familiar to you. Though you probably don't 
remember it, they were undoubtedly quite strange and foreign when you first saw them. 
Tensor notation (tensor structures) will probably affect you the same way. To make mat- 
ters worse, unlike the examples we cited here, tensor notation varies widely among differ- 
ent researchers. One person's tensor notation often dramatically conflicts with notation 
adopted by another researcher (their notations can't coexist peacefully like y x and "y A x"). 
Neither researcher has committed an atrocity — they are both within rights to use what- 
ever notation they desire. Don't get into cat fights with others about their notation prefer- 
ences. People select notation in a way that works best for their application or for the 
audience they are trying to reach. Tensor analysis is such a rich field of study that variants 
in tensor notation are a fact of life, and attempts to impose uniformity is short-sighted 
folly. However, you are justified in criticizing another person's notation if they are not 
self-consistent within a single publication. 

The assembly of symbols, - , is a standard structure for division and rs is a standard 

structure for multiplication. Being essentially the study of structures, mathematics permits 

ab 
us to construct unambiguous meanings of "superstructures" such as — and consistency 

rs 
rules (i.e., theorems) such as 

ab b -r ,„ > N 

— = - if a = r (1.1) 

rs s 
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We've already mentioned that the same operation might be denoted by different struc- 
tures (e.g., "y A x" means the same thing as y x ). Conversely, it's not unusual for structures 
to be overloaded, which means that an identical arrangement of symbols on the page can 
have different meaning depending on the meanings of the constituent "parts" or depending 
on context. For example, we mentioned that "— = - if a = r", but everyone knows that 

rs s 

you shouldn't use the same rule to cancel the "d"s in a derivative -^ to claim it equals y - . 
The derivative is a different structure. It shares some manipulation rules with fractions, but 
not all. Handled carefully, structure overloading can be a powerful tool. If, for example, a 
and (3 are numbers and v is a vector, then structure overloading permits us to write 
(a + P)v = av + Pv . Here, we overloaded the addition symbol "+"; it represents addition 
of numbers on the left side but addition of vectors on the right. Structure overloading also 
permits us to assert the heuristically appealing theorem ^~ = & ; in this context, the hor- 

clx clz dz 

izontal bar does not denote division, so you have to prove this theorem — you can't just 
"cancel" the "Jx"s as if these really were fractions. The power of overloading (making 
derivatives look like fractions) is evident here because of the heuristic appearance that 
they cancel just like regular fractions. 

In this book, we use the phrase "tensor structure" for any tensor notation system that is 
internally(self)-consistent, and which everywhere obeys its own rules. Just about any per- 
son will claim that his or her tensor notation is a structure, but careful inspection often 
reveals structure violations. In this book, we will describe one particular tensor notation 
system that is, we believe, a reliable structure.* Just as other researchers adopt a notation 
system to best suit their applications, we have adopted our structure because it appears to 
be ideally suited to generalization to higher-order applications in materials constitutive 
modeling. Even though we will carefully outline our tensor structure rules, we will also 
call attention to alternative notations used by other people. Having command of multiple 
notation systems will position you to most effectively communicate with others. Never 
(unless you are a professor) force someone else to learn your tensor notation preferences 
— you should speak to others in their language if you wish to gain their favor. 

We've already seen that different structures are routinely used to represent the same 
function or operation (e.g. y x means the same thing as "y A x"). Ideally, a structure should 
be selected to best match the application at hand. If no conventional structure seems to do 
a good job, then you should feel free to invent your own structures or superstructures. 
However, structures must always come equipped with unambiguous rules for definition, 
assembly, manipulation, and interpretation. Furthermore, structures should obey certain 
"good citizenship" provisos. 

(i) If other people use different notations from your own, then 
you should clearly provide an explanation of the meaning of 
your structures. For example, in tensor analysis, the structure 



* Readers who find a breakdown in our structure are encouraged to notify us. 
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A:B often has different meanings, depending on who writes 
it down; hence, if you use this structure, then you should 
always define what you mean by it. 

(ii) Notation should not grossly violate commonly adopted "stan- 
dards." By "standards," we are referring to those everyday 
bread-and-butter structures that come implicitly endowed 
with certain definitions and manipulation rules. For example, 
"x + y " had darned will better stand for addition — only a 
deranged person would declare that the structure "x + y " 
means division of x by y (something that the rest of us would 
denote by - , x/y , X +y or even y\~X~). Similarly, the words 
you use to describe your structures should not conflict with 
universally recognized lexicon of mathematics, (see, for 
example, our discussion of the phrase "inner product.") 

(Hi) Within a single publication, notation should be applied con- 
sistently. In the continuum mechanics literature, it is not 
uncommon for the structure Vv (called the gradient of a vec- 
tor) to be defined in the nomenclature section in terms of a 
matrix whose ij components are 3v/3x ; -. Unfortunately, 
however, within the same publication, some inattentive 
authors later denote the "velocity gradient" by Vv but with 
components dv { /dx- — that's a structure self-consistency 
violation! 

(iv) Exceptions to structure definitions are sometimes unavoid- 
able, but the exception should always be made clear to the 
reader. For example, in this book, we will define some 
implicit summation rules that permit the reader to know that 
certain things are being summed without a summation sign 
present. There are times, however, that the summation rules 
must be suspended and structure consistency demands that 
these instances must be carefully called out. 



What is a scalar? What is a vector? 

This physical introduction may be skipped. You may go directly to page 21 without loss. 

We will frequently exploit our assumption that you have some familiarity with vector 
analysis. You are expected to have a vague notion that a "scalar" is something that has 
magnitude, but no direction; examples include temperature, density, time, etc. At the very 
least, you presumably know the sloppy definition that a vector is "something with length 
and direction." Examples include velocity, force, and electric field. You are further pre- 
sumed to know that an ordinary engineering vector can be described in terms of three 
components referenced to three unit base vectors. A prime goal of this book is to improve 
this baseline "undergraduate's" understanding of scalars and vectors. 
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In this book, scalars are typeset in plain italic (a, b, c, ...). Vectors are typeset in bold 
with a single under-tilde (for example, v), and their components are referred to by num- 
bered subscripts (v ls v 2 , v 3 ). Introductory calculus courses usually denote the orthonormal 
Cartesian base vectors by {i,j, k} , but why give up so many letters of the alphabet? We 
will use numerically subscripted symbols such as {e p e 2 , e 3 } or {E x , E 2 , E 3 } to denote 
the orthonormal base vectors. 

As this book progresses, we will improve and refine our terminology to ultimately pro- 
vide the mathematician's definition of the word "vector." This rigorous (and therefore 
abstract) definition is based on testing the properties of a candidate set of objects for cer- 
tain behaviors under proposed definitions for addition and scalar multiplication. Many 
engineering textbooks define a vector according to how the components change upon a 
change of basis. This component transformation viewpoint is related to the more general 
mathematician's definition of "vector" because it is a specific instance of a discerning def- 
inition of membership in what the mathematician would see as a candidate set of 
"objects." For many people, the mathematician's definition of the word "vector" sparks an 
epiphany where it is seen that a lot of things in math and in nature function just like ordi- 
nary (engineering) vectors. Learning about one set of objects can provide valuable insight 
into a new and unrelated set of objects if it can be shown that both sets are vector spaces in 
the abstract mathematician's sense. 



What is a tensor? 

This section may be skipped. You may go directly to page 21 without loss. 

In this book we will assume you have virtually zero pre-existing knowledge of tensors. 
Nonetheless, it will be occasionally convenient to talk about tensor concepts prior to care- 
fully defining the word "tensor," so we need to give you a vague notion about what they 
are. Tensors arise when dealing with functions that take a vector as input and produce a 
vector as output. For example, if a ball is thrown at the ground with a certain velocity 
(which is a vector), then classical physics principals can be use to come up with a formula 
for the velocity vector after hitting the ground. In other words, there is presumably a func- 
tion that takes the initial velocity vector as input and produces the final velocity vector as 
output: v final = /(v imtial ) . When grade school kids learn about scalar functions 
iy = f( x ))> they first learn about straight lines. Later on, as college freshman, they learn 
the brilliant principle upon which calculus is based: namely, nonlinear functions can be 
regarded as a collection of infinitesimal straight line segments. Consequently, the study of 
straight lines forms an essential foundation upon which to study the nonlinear functions 
that appear in nature. Like scalar functions, vector-to-vector functions might be linear or 
non-linear. Very loosely speaking, a vector-to-vector transformation y = fix) is linear if 
the components of the output vector y can be computed by a square 3x3 matrix [m] act- 
ing on the input vector x : 



If you are not familiar with how to multiply a 3 x 3 matrix times a 3 x 1 array, see page 22. 
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Consider, for example, our function that relates the 
pre-impact velocity to the post-impact velocity for a 
ball bouncing off a surface. Suppose the surface is fric- 
tionless and the ball is perfectly elastic. If the normal to 
the surface points in the 2-direction, then the second 
component of velocity will change sign while the other 
components will remain unchanged. This relationship 
can be written in the form of Eq. (1.2) as 
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,, final 
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1; final 
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,, initial 
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,, initial 
v 2 

,, initial 
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(1.3) 



The matrix [M] in Eq. (1.2) plays a role similar to the role played by the slope m in the 
most rudimentary equation for a scalar straight line, y = mx . For any linear vector-to- 
vector transformation, y = f(x) , there always exists a second-order tensor [which we will 
typeset in bold with two under-tildes, M] that completely characterizes the transforma- 
tion. ' We will later explain that a tensor M always has an associated 3x3 matrix of com- 
ponents. Whenever we write an equation of the form 



M»x. 



(1.4) 



it should be regarded as a symbolic (more compact) expression equivalent to Eq. (1.2). As 
will be discussed in great detail later, a tensor is more than just a matrix. Just as the com- 
ponents of a vector change when a different basis is used, the components of the 3x3 
matrix that characterizes a tensor will also change when the underlying basis changes. 
Conversely, if a given 3x3 matrix fails to transform in the necessary way upon a change 
of basis, then that matrix must not correspond to a tensor. For example, let's consider 
again the bouncing ball model, but this time, we will set up the basis differently. If we had 
declared that the normal to the surface pointed in the 3-direction instead of the 2-direction, 
then Eq. (1.3) would have ended up being 



* Incidentally, the operation y = mx + b is not linear. The proper term is "affine." Note that 
y-b = mx . Thus, by studying linear functions, you are only a step away from affine functions (just 
add the constant term after doing the linear part of the analysis). 

t Existence of the tensor is ensured by the Representation Theorem, covered later in Eq. 9.7. 
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(1.5) 



Note that changing the basis forced a change in the [M] 
matrix. Less trivially, if we had set up the basis by rotat- 
ing it 45 ° clockwise, then the formula would have been 
given by the far less intuitive or obvious relationship 



(1.6) 
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We have not yet covered the formal process for determining how the components of the 
tensor M must vary with a change in basis, so don't be dissuaded if you don't know how 
we came up with the components shown in Eq. (1.6). One thing you can do at this stage is 
double-check the equation for some special cases where you know what the answer should 
be. For example, with this rotated basis, if the ball has an incoming trajectory that happens 
to be parallel to e l , then examining the picture should tell you that the outgoing trajectory 
should be parallel to e 2 , and the above matrix equation does indeed predict this result. 
Another special case you can consider is when the incoming trajectory is headed straight 
down toward the surface so that y imtial is parallel to e x - e 2 , which corresponds to a com- 
ponent array {1,-1,0}. Then the matrix operation of Eq. (1.6) would give 



, final 



, final 



, final 



is parallel to 
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, or 


-l 
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(1.7) 



This means the outgoing final velocity is parallel to e 2 -e x , which (referring to the 
sketch) is straight up away from the surface, as expected. The key point here is: if you 
know the component matrix for a tensor with respect to one basis, then there exists a for- 
mal procedure (discussed later in this book) that will tell you what the component matrix 
must look like with respect to a different basis. 



At this point, we have provided only an extremely vague and undoubtedly disquieting 
notion of the meaning of the word "tensor." The sophistication and correctness of this pre- 
liminary definition is on a par with the definition of a vector as "something with length 
and direction." A tensor is the next step in complexity — it is a mathematical abstraction 
or book-keeping tool that characterizes how something with length and direction trans- 
forms into something else with length and direction. It plays a role in vector analysis simi- 
lar to the concept of slope in algebra. 
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Examples of tensors in materials mechanics. 

This section may be skipped. You may go directly to page 21 without loss. 



The stress tensor. In materials modeling, the "stress tensor" plays a pivotal role. If a 
blob of material is subjected to loads (point forces, body forces, distributed pressures, etc.) 
then it generally reacts with some sort of internal resistance to these loads (viscous, iner- 
tial, elastic, etc.). As a "thought experiment", imagine that you could pass a plane through 
the blob (see Fig. 1.1). To keep the remaining half-blob in the same shape it was in before 
you sliced it, you would need to approximate the effect of the removed piece by imposing 
a traction (i.e., force per unit area) applied on the cutting plane. 

TRACTION: 
force per unit 
area. 




Traction depends on 
wM orientation of the 
cutting plane 



Figure 1.1. The concept of traction. When a body is conceptually split in half by a planar surface, the 
effect of one part of the body on the other is approximated by a "traction", or force per unit area, applied 
on the cutting plane. Traction is an excellent mathematical model for macroscale bodies (i.e., bodies con- 
taining so many atom or molecules that they may be treated as continuous). Different planes will generally 
have different traction vectors. 

Force is a vector, so traction (which is just force per unit area) must be a vector too. 
Intuitively, you can probably guess that the traction vector needs to have different values 
at different locations on the cutting plane, so traction naturally is a function of the position 
vector x . The traction at a particular location x also depends on the orientation of the cut- 
ting plane. If you pass a differently oriented plane through the same point x in a body, 
then the traction vector at that point will be different. In other words, traction depends on 
both the location in the body and the orientation of the cutting plane. Stated mathemati- 
cally, the traction vector t at a particular position x varies as a function of the plane's out- 
ward unit normal n . This is a vector-to-vector transformation! In this case, we have one 
vector (traction) that depends on two vectors, x and n . Whenever attempting to under- 
stand a function of two variables, it is always a good idea to consider variation of each 
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variable separately, observing how the function behaves when only one variable changes 
while the other is held constant. Presumably, at a given location x , a functional relation- 
ship exists between the plane's orientation n and the traction vector t . Using the contin- 
uum mechanics version of the famous F = ma dynamics equation, Cauchy proved that 
this relationship between traction and the plane orientation must be linear. Whenever you 
discover that a relationship is linear, you can call upon a central concept of tensor analy- 
sis to immediately state that it is expressible in the form of Eq. (1.2). In other words, 
there must exist a tensor, which we will denote a and refer to as "stress," such that 

t=a»n (1.8) 

Remember that this conclusion resulted from considering variation of n while holding x 
fixed. The dependence of traction on x might still be nonlinear, but it is a truly monumen- 
tal discovery that the dependence on n is so beautifully simple. Written out, showing the 
independent variables explicitly, 

t(x, n) = q{x) • n (1.9) 

This means the stress tensor itself varies through space (generally in a nonlinear manner), 
but the dependence on the cutting plane's normal n is linear. As suggested in Fig. 1.1, the 
components of the stress tensor can be found if the traction is known on the faces of the 
cube whose faces are aligned with the coordinate directions. Specifically, the / th column 
of the component matrix [a] contains the traction vector acting on the /' th face of the 
cube. These "stress elements" don't really have finite spatial extent — they are infinitesi- 
mal cubes and the tractions acting on each face really represent the traction vectors acting 
on the three coordinate planes that pass through the same point in the body. 



Namely, the Representation Theorem covered later in Eq. 9.7. 
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The deformation gradient tensor. The stress tensor characterizes the local orienta- 
tion-dependent loads (force per area) experienced by a body. A different tensor — the 
"deformation gradient" — characterizes the local volume changes, local orientation 
changes, and local shape changes associated with deformation. If you paint an infinitesi- 
mal square onto the surface of a blob of putty, then the square will deform into a parallelo- 
gram (Fig. 1.2). 





Figure 1.2. Stretching silly putty. The square flows with the material to become a parallel- 
ogram. Below each figure, is shown how the square and parallelogram can be described by two 
vectors. 

The unit base vectors {E V E 2 } forming the edges of the initial square, will stretch 
and rotate to become new vectors, {g., g 2 } , forming the edges of the deformed parallelo- 
gram. These ideas can be extended into 3D if one pretends that a cube could be "painted" 
inside the putty. The three unit vectors forming the edges of the initial cube deform into 
three stretched and rotated vectors forming the edges of the deformed parallelepiped. 
Assembling the three g. vectors into columns of a 3 x 3 matrix will give you the matrix 
of the deformation gradient tensor. Of course, this is only a qualitative description of the 
deformation gradient tensor. A more classical (and quantified) definition of the deforma- 
tion gradient tensor starts with the assertion that each point x in the currently deformed 
body must have come from some unique initial location X in the initial undeformed refer- 
ence configuration, you can therefore claim that a mapping function x = f(X) must exist. 
This is a vector-to-vector transformation, but it is generally not linear. Recall that tensors 
characterize linear functions that transform vectors to vectors. However, just as a nonlin- 
ear algebraic function (e.g., a parabola or a cosine curve or any other nonlinear function) 
can be viewed as approximately linear in the limit of infinitesimal portions (the local slope 
of the straight tangent line is determined by differentiating the function), the deformation 
mapping is linear when expressed in terms of infinitesimal material line segments dX and 
dx . Specifically, if x = f(X) , then the deformation gradient tensor F is defined so that 
dx = F • dX . Not surprisingly, the Cartesian component matrix for F is given by 



* Making the infinitesimal square into a unit square is merely a matter of choosing a length unit 
appropriately. All that really matters here is the ratio of deformed lengths to initial lengths. 
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F- = dx/dXj. While this might be the mathematical formula you will need to use to 
actually compute the deformation gradient, it is extremely useful to truly understand the 
basic physical meaning of the tensor too (i.e., how it shows how squares deform to paral- 
lelepipeds). All that is needed to determine the components of this (or any) tensor is 
knowledge of how that transformation changes any three linearly independent vectors. 



Vector and Tensor notation — philosophy 

This section may be skipped. You may go directly to page 21 without loss. 

Tensor notation unfortunately remains non-standardized, so it's important to at least 
scan any author's tensor notation section to become familiar with his or her definitions and 
overall approach to the subject. Authors generally select a vector and tensor notation that 
is well suited for the physical problem of interest to them. In general, no single notation 
should be considered superior to another. 

Our tensor analysis notational preferences are motivated to simplify our other (more 
complicated and contemporary) applications in materials modeling. Different technical 
applications frequently call for different notational conventions. The unfortunate conse- 
quence is that it often takes many years to master tensor analysis simply because of the 
numerous (often conflicting) notations currently used in the literature. Table 1.1, for 
example, shows a sampling of how our notation might differ from other books you might 
read about tensor analysis. This table employs some conventions (such as implicit indicial 
notation) that we have not yet defined, so don't worry that some entries are unclear. The 
only point of this table is to emphasize that you must not presume that the notation you 
learn in this book will necessarily jibe with the notation you encounter elsewhere. Note, 
for example, that our notation A • B is completely different from what other people might 
intend when they write A • B . As a teaching tool, we indicate tensor order (also called 
rank, to be defined soon) by the number of "under-tildes" placed under a symbol. You 
won't see this done in most books, where tensors and vectors are typically typeset in bold 
and it is up to you to keep track of their tensor order. 

Table 1.1: Some conflicting notations 



Operation 


Cartesian Indicial 
Notation 


Our 
Notation 


Other 
Notations 


Linear transformation of a 
vector x into a new vector v 


v, = F ijXj 


v = F»x 


v = Fx 


Composition of two tensors 
A and B 


C tJ = A lk B kj 


C = A»B 


C = AB 


Inner product of two tensors 
A and B 


s = A iJ B iJ 


s = A:B 


s = A»B 


Dot product of a vector W 
into a linear transformation 


s = w i F ij x j 


w • F • x 


s = w • Fx 
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In this book, we will attempt to cover the most popular tensor analysis notations. One 
important notation system not covered in this book is the one used with general curvilinear 
coordinates. You can recognize (or suspect) that a person is using general curvilinear nota- 
tion if they write formulas with indices positioned as both subscripts and superscripts (for 
example, where we would write v • = F i -x ■ in Cartesian notation, a person using curvilin- 
ear notation might instead write something like v l = F l x 7 ). When an author is using gen- 
eral curvilinear notation, their calculus formulas will look somewhat similar to the 
Cartesian calculus formulas we present in this book, but their curvilinear formulas will 
usually have additional terms involving strange symbols like { k .} or Ff- called "Christof- 
fel" symbols. Whenever you run across indicial formulas that involve these symbols or 
when the author uses a combination of subscripts and superscripts, then you are probably 
reading an analysis written in general curvilinear notation, which is not covered in this 
book. In this case, you should use this book as a starting point for first learning tensors in 
Cartesian systems, and then move on to our separate book [6] for generalizations to curvi- 
linear notation. An alternative approach is to "translate" an author's curvilinear equations 
into equivalent Cartesian equations by changing all superscripts into ordinary subscripts 
and by setting every Christoffel symbol equal to zero. This translation is permissible only 
if you are certain that the original analysis applies to a Euclidean space (i.e., to a space 
where it is possible to define a Cartesian coordinate system). If, for example, the author's 
analysis was presented for the 2D curvilinear surface of a sphere, then it cannot be trans- 
lated into Cartesian notation because the surface of a sphere is a non-Euclidean space (you 
can't draw a map of the world on a 2D piece of paper without distorting the countries). On 
the other hand, if the analysis was presented for ordinary 3D space, and the author merely 
chose to use a spherical coordinate system, then you are permitted to translate the results 
into Cartesian notation because ordinary 3D space admits the introduction of a Cartesian 
system. 

Any statement we make here in this book that is cast in direct structured notation 
applies equally well to Cartesian and curvilinear systems. Direct structured equations 
never used components or base vectors. They represent physical operations with meanings 
quite independent of whatever coordinate or basis you happen to use. For example, when 
we say that v • w equals the magnitudes of v and w times the cosine of the angle between 
them, that interpretation is valid regardless of your coordinate system. However, when we 
say v • w = v l w l + v 2 w 2 + v 3 w 3 , then that statement (because it involves indexed com- 
ponents) holds only for Cartesian systems. The physical operation v • w is computed one 
way in Cartesian coordinates and another way in curvilinear — the value and meaning of 
the final result is the same for both systems. 
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"Change isn 't painful, but resistance to 
change is. ' — unattributed 

2. Terminology from functional analysis 

RECOMMENDATION: Do not read this section in extreme detail. Just scan 
it to get a basic idea of what terms and notation are defined here. Then go 
into more practical stuff starting on page 21 . Everything discussed in this 
section is listed in the index, so you can come back here to get definitions of 
unfamiliar jargon as the need arises. 

Vector, tensor, and matrix analysis are subsets of a more general area of study called 
functional analysis. One purpose of this book is to specialize several overly-general results 
from functional analysis into forms that are the more convenient for "real world" engi- 
neering applications where generalized abstract formulas or notations are not only not 
necessary, but also damned distracting. Functional analysis deals with operators and their 
properties. For our purposes, an operator may be regarded as a function f(x) . If the argu- 
ment of the function is a vector and if the result of the function is also vector, then the 
function is usually called a transformation because it transforms one vector to become a 
new vector. 

In this book, any non-underlined quantity is just an ordinary number (or, using more 
fancy jargon, scalar* or field member). Quantities such as v or « with a single squiggly 
underline (tilde) are vectors. Quantities such as A or I with two under-tildes are second- 
order tensors. In general, the number of under-tildes beneath a symbol indicates to you the 
order of that tensor (for this reason, scalars are sometimes called zeroth-order tensors and 
vectors are called first-order tensors). Occasionally, we will want to make statements that 
apply equally well to tensors of any order. In that case, we might use single straight under- 
lines. Quantities with single straight underlines (e.g., x or y) might represent scalars, vec- 
tors, tensors, or other abstract objects. We follow this convention throughout the text; 
namely, when discussing a concept that applies equally well to a tensor of any order (sca- 
lar, vector, second-order tensor), then we will use straight underlines or, possibly only 
bold typesetting with no underlines at all.t When discussing "objects" of a particular 



Strictly speaking, the term "scalar" does not apply to any old number. A scalar must be a number 
(such as temperature or density) whose value does not change when you reorient the basis. For 
example, the magnitude of a vector is a scalar, but any individual component of a vector (whose 
value does depend on the basis) is not a scalar — it is just a number. 
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order, then we will use "under-tildes", and the total number of under-tildes will equal the 
order of the object. The use of under-tildes and underlines is a teaching tool. In journal 
publications, you will usually see vectors and tensors typeset in bold with no underlines, 
in which case it will be up to you to keep track of the tensor order of the quantities. 

Some basic terminology from functional analysis is defined very loosely below. More 
mathematically correct definitions will be given later, or can be readily found in the litera- 
ture [e.g., Refs 33, 28, 29, 30, 31, 12]. Throughout the following list, you are presumed to 
be dealing with a set of "objects" (scalars, vectors, or perhaps something more exotic) for 
which scalar multiplication and "object" addition have well-understood meanings that you 
(or one of your more creative colleagues) have dreamed up. The diminutive single 
dot " • " multiplication symbol represents ordinary multiplication when the arguments 
are just scalars. Otherwise, it represents the appropriate inner product depending on the 
arguments (e.g., it's the vector dot " • " product if the arguments are vectors; it's the ten- 
sor double dot ".* " product — defined later — when the arguments are tensors); a mathe- 
matician's definition of the "inner product" may be found on page 233. 

• A "linear combination" of two objects x and y is any object r that can be 
expressed in the form r = ax + fiy for some choice of scalars a and p . A "linear 
combination" of three objects (x , y , and z ) is any object r that can be expressed 
in the form r = ax + fiy + yz . Of course, this definition makes sense only if you have 
an unambiguous understanding of what the objects represent. Moreover, you must 
have a definition for scalar multiplication and addition of the objects. If, for example, 
the "objects" are 1 x 2 matrices, then scalar multiplication ax of some matrix 

x = [x,, x 2 ] would be defined [aij, ax 2 ] and the linear combination ax + fiy 
would be a 1 x 2 matrix given by [ax l + $y x , ax 2 + fiy 2 ] ■ 

• A function / is "linear" if /(ax + p>) = af(x) + fif(y) for all a , P , x , and y . This 
means that applying the function to a linear combination of objects will give the same 
result as instead first applying the function to the objects, and then computing the 
linear combination afterward. Linearity is a profoundly useful property. Incidentally, 
the definition of linearity demands that a linear function must give zero when applied 
to zero: f(0) = . Therefore, the classic formula for a straight line, 

y = fix) = mx + b , is not a linear function unless the line passes through the origin 
(i.e., unless b = ). Most people (including us) will sloppily use the term "linear" 
anyway, but the correct term for the straight line function is "affine." 

• A transformation g is "affine" if it can be expressed in the form g(x) = f(x) + b , 
where b is constant and f is a linear function. 

• A transformation /is "self-adjoint" if y -fix) = x -f(y). When applied to a linear 



f At this point, you are not expected to already know what is meant by the term "tensor," much less 
the "order" of a tensor or the meaning of the phrase "inner product." For now, consider this section 
to apply to scalars and vectors. Just understand that the concepts reviewed in this section will also 
apply in more general tensor settings, once learned. 



15 

Copyright is reserved. Individual copies may be made for personal use. No part of this document may be reproduced for profit. 



September 4, 2003 5:24 pm 
Terminology from functional analysis 



vector-to-vector transformation, the property of self-adjointness will imply that the 
associated tensor must be symmetric (or "hermitian" if complex vectors are 
permitted. This document limits its scope to real vectors except where explicitly noted 
otherwise, so don 't expect comments like this to continue to litter the text. It 's your 
job to remember that many formulas and theorems in this book might or might not 
generalize to complex vectors. 

A transformation / is a projector if fifix)) = fix) . The term "idempotent" is also 
frequently used. A projector is a function that will keep on returning the same result 
if it is applied more than once. Projectors that appear in classical Newtonian physics 
are usually linear, although there are many problems of engineering interest that 
involve nonlinear projectors — if one is attuned enough to look for them. 

Any operator / must have a domain of admissible values of x for which fix) is 
well-defined. Throughout this book, the domain of a function must be inferred by you 
so that the function "makes sense." For example, if f{x) = l/x, then you are 
expected to infer that the domain is the set of nonzero x . We aren't going to waste 
your time by saying it. Furthermore, throughout this book, all scalars, vectors and 
tensors are assumed to be real unless otherwise stated. Consequently, whenever you 
see x 2 , you may assume the result is non-negative unless you are explicitly told that 
x might be complex. 

The "codomain" of an operator is the set of all y values such that y = fix) . For 
example, if fix) = x 2 , then the codomain is the set of nonnegative numbers, 
whereas the range is the set of reals. The term range space will often be used to 
refer to the range of a linear operator. 

A set S is said to be "closed" under a some particular operation if application of that 
operation to a member of S always gives a result that is itself a member of S. For 
example, the set of all symmetric matrices ' is closed under matrix addition because 
the sum of two symmetric matrices is itself a symmetric matrix. By contrast, set of all 
orthogonal matrices is not closed under matrix addition because the sum of two 
orthogonal matrices is not generally itself an orthogonal matrix. Similarly, the set of 
all unit vectors is not closed under vector addition because the sum of two unit vectors 
does not result in a unit vector. 

The null space of an operator is the set of all x for which fix) = . 

For each input x , a well-defined proper operator / must give a unique output 

y = fix) ■ I n other words, a single x must never correspond to two or more possible 

values of y . The operator is called one-to-one if the reverse situation also holds. 



* This follows because we have already stated that x is to be presumed real. 
t Matrices are defined in the next section. 
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Namely, f is one-to-one if each y in the codomain of/ is obtained by a unique x such 
that y—f{x) . For example, the function f(x) = x 2 is not one-to-one because a single 
value of y can be obtained by two values of x (e.g., y=4 can be obtained by x=2 or 
x=-2). 

Given two proper functions y = g(t) and x = h{t) , you may presume that a 
parametric relationship exists between y and x, but this relationship (sometimes 
called an implicit function) might not be a proper function at all. Because g and h 
are proper functions, it is true that each value of the parameter t will correspond to 
unique values of y and x . When these values are assembled together into a graph or 
table over the range of every possible value of t, then the result is called a phase 
diagram or phase space. For example, if y = sin? and x = cos t , then the phase 
diagram would be a circle in y versus x phase space. 

If a function is one-to-one, then it is invertible. The inverse f~ l is defined such that 

x=f- l (y). 

A set of "objects" is linearly independent if no member of the set can be written 
as a linear combination of the other members of the set. If, for example, the " objects" 
are 1 x 2 matrices, then the three-member set {[1,2], [3,4], [5,6]} is not linearly 
independent because the third matrix can be expressed as a linear combination of the 
first two matrices; namely, [5,6] = (-1)[1, 2] + (2)[3, 4] . 

The span of a collection of vectors is the set of all vectors that can be written as a 
linear combination of the vectors in the collection. For example, the span of the two 
vectors { 1, 1,0} and {1,-1,0} is the set of all vectors expressible in the form 
aj{ 1, 1, 0} + a 2 {l, -1, 0} . This set of vectors represents any vector {x 1; x 2 , x 3 } 
for which x 3 =0 . The starting collection of vectors does not have to be linearly 
independent in order for the span to be well-defined. Linear spaces are often 
described by using spans. For example, you might hear someone refer to "the plane 
spanned by vectors a and b ," which simply means the plane containing a and b . 

The dimension of a set or a space equals the minimum quantity of "numbers" that 
you would have to specify in order to uniquely identify a member of that set. In 
practice, the dimension is often determined by counting some nominally sufficient 
quantity of numbers and then subtracting the number of independent constraints that 
those numbers must satisfy. For example, ordinary engineering vectors are specified 
by giving three numbers, so they are nominally three dimensional. However, the set 
of all unit vectors is two-dimensional because the three components of a unit vector 
n must satisfy the one constraint, n\ + n| + n 2 = 1 . We later find that an 
engineering "tensor" can be specified in terms of a 3 x 3 matrix, which has nine 
components. Therefore engineering "tensor space" is nine-dimensional. On the other 
hand, the set of all symmetric tensors is s/x-dimensional because the nine nominal 
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components must obey three constraints (T u = T 2l , T 23 = T 32 , and T 3l = T n ). 

Note that the set of all unit vectors forms a two-dimensional subset of the 3D space 
of ordinary engineering vectors. This 2D subset is curvilinear — each unit vector can 
be regarded as a point on the surface of the unit sphere. Sometimes a subset will be 
fiat. For example, the set of all vectors whose first component is zero (with respect to 
some fixed basis) represents a "flat" space (it is the plane formed by the second and 
third coordinate axes). The set of all vectors with all three components being equal is 
geometrically a straight line (pointing in the 111 direction). It is always worthwhile 
spending a bit of time getting a feel for the geometric shape of subsets. If the shape is 
"flat" (e.g. a plane or a straight line), then it is called a linear manifold (defined 
better below). Otherwise it is called curvilinear. If a surface is curved but could be 
"unrolled" into a flat surface or into a line, then the surface is called Euclidean; 
qualitatively, a space is Euclidean if it is always possible to set up a coordinate grid 
covering the space in such a manner that the coordinate grid cells are all equal sized 
squares or cubes. The surface of a cylinder is both curvilinear and Euclidean. By 
contrast, the surface of a sphere is curvilinear and non-Euclidean. Mapping a non- 
Euclidean space to Euclidean space will always involve distortions in shape and/or 
size. That's why maps of the world are always distorted when printed on two- 
dimensional sheets of paper. 

If a set is closed under vector addition and scalar multiplication (i.e., if every linear 
combination of set members gives a result that is also in the set), then the set is called 
a linear manifold, or a linear space. Otherwise, the set is curvilinear. The set of 
all unit vectors is a curvilinear space because a linear combination of unit vectors does 
not result in a unit vector. Linear manifolds are like planes that pass through the 
origin, though they might be "hyperplanes," which is just a fancy word for a plane 
of more than just two dimensions. Linear spaces can also be one-dimensional. Any 
straight line that passes through the origin is a linear manifold. 

Zero must always be a member of a linear manifold, and this fact is often a great place 
to start when considering whether or not a set is a linear space. For example, you can 
assert that the set of unit vectors is not a linear space by simply noting that the zero 
vector is not a unit vector. 

A plane that does not pass through the origin must not be a linear space. We know this 
simply because such a plane does not contain the zero vector. This kind of plane is 
called an "affine" space. An "affine" space is a set that would become a linear space 
if the origin were to be moved to any single point in the set. For example, the point 
(0, b) lies on the straight line defined by the equation, y = mx + b . If you move the 
origin from O = (0, 0) to a new location O* = (0, b) , and introduce a change of 
variables x* = x - and y* = y - b , then the equation for this same line described 
with respect to this new origin would become y* = mx* , which does describe a 
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linear space. Stated differently, a set S is affine if every member x in that set is 
expressible in the form of a constant vector d plus a vector x* that does belong to a 
linear space. Thus, learning about the properties of linear spaces is sufficient to learn 
most of what you need to know about affine spaces. 

Given an ^-dimensional linear space, a subset of members of that space is basis if 
every member of the space can be expressed as a linear combination of members of 
the subset. A basis always contains exactly as many members as the dimension of the 
space. 

A "binary" operation is simply a function or transformation that has two arguments. 
For example, fix, y) = x 2 cosj is a binary operation. 

A binary operation f(x, y) is called "bilinear" if it is linear with respect to each of 
its arguments individually; i.e., f(a l x l + a 2 x 2 ,y) = a l f(x l ,y) + a 2 f(x 2 ,y) and 
f(x, Pjj. + P^?) = Pi/fe^i) + fiifi^yo) ■ L ate r on, after we introduce the notion 
of tensors, we will find that scalar-valued bilinear functions are always expressible in 
the form fix, y) = x • A • y , where A is a constant second-order tensor. 

The notation for an ordinary derivative dy/dx will, in this book, carry with it several 
implied assumptions. The very act of writing dy/dx tells you that y is expressible 
solely as a function of x and that function is differentiable. 

An "equation" of the form y = y(x) is not an equation at all. This will be our 
shorthand notation indicating that y is expressible as a function of x . 

The notation for a partial derivative dy/dx tells you that y is expressible as a 
function of x and something else. A partial derivative is meaningless unless you 
know what the "something else" is. Consider, for example, polar coordinates r and 
9 related to Cartesian coordinates x and y by x = rcosG and y = rsinG . Writing 
dy/dr is sloppy. You might suspect that this derivative is holding 9 constant, but it 
might be that it was really intended to hold x constant. All partial derivatives in this 
book will indicate what variable or variables are being held constant by showing them 
as subscripts. Thus, for example, {dy/dr) Q is completely different from {dy/dr) x . 
An exception to this convention exists for derivatives with respect to subscripted 
quantities. If for example, it is known that z is a function of three variables s x ,s 2 ,s^, 
then dz/ds 2 should be interpreted to mean (dz/ds 2 ) 

An expression fix, y)dx + g(x, y)dy is called an exact differential if there exists a 
function u(x, y) such that du = fdx + gdy . A necessary and sufficient condition for 
the potential function u to exist is (df/dy) x = (dg/dx) . If so, then it must be true 
that f(x,y) = (du/dx) and g(x,y) = ( du /dy) x . You would integrate these 
equations to determine u(x, y) . Keep in mind that the "constant" of integration with 
respect to x must be a function h(y) . 



19 

Copyright is reserved. Individual copies may be made for personal use. No part of this document may be reproduced for profit. 



September 4, 2003 5:24 pm 
Terminology from functional analysis 



IMPORTANT (notation discussion) . An identical restatement of the above discussion 
of exact differentials can be given by using different notation where the symbols 
x x and x 2 are used instead of x and y . Similarly, the symbols f x and f 2 can be used 
to denote the functions instead of/ and g . In ensemble, the collection {x x , x 2 } can 
be denoted symbolically by x . With this change, the previous definition reads as 
follows: An expression f x dx x +f 2 dx 2 is called an exact differential if and only if 
the following two conditions are met: (1) f k = f k (x) and (2) there exists a function 
u(x) such that du = f x dx x +f 2 dx 2 . If so, then it must be true that f k = du/dx k , 
which (because k takes values from 1 to 2) represents a set of two equations that may 
be integrated to solve for u . A necessary and sufficient condition for the potential 
function u to exist (i.e., for the equations to be integrable) is df x /dx 2 = df 2 /dx x . 
When using variable symbols that are subscripted as we have done here it is 
understood that partial differentiation with respect to one subscripted quantity holds 
the other subscripted quantity constant. For example, the act of writing df x /dx 2 tells 
the reader that f x can be written as a function of x x and x 2 and it is understood that 
x x is being held constant in this partial derivative. Recall that, if the equations are 
integrable, then it will be true that f k = du/dx k . Consequently, the integrability 
condition, df x /dx 2 = df 2 /dx x is asserting that d 2 u/dx x dx 2 = d 2 u/dx 2 dx x — in 
other words, the mixed partial derivatives must give the same result regardless of the 
order of differentiation. Note that the expression du = f x dx x +f 2 dx 2 can be written 
in symbolic (structured) notation as du = f ■ dx and the expression f k = du/dx k 
can be written / = Vw , where the gradient is taken with respect to x . The increment 
in work associated with a force / pushing a block a distance dx along africtional 
surface is an example of a differential form /• dx that is not an exact differential. In 
this case where no potential function exists, but the expression is still like an 
increment, it is good practice to indicate that the expression is not an exact differential 
by writing a "slash" through the "d", as in du = f ■ dx; for easier typesetting, some 
people write 8u = f ■ dx .By contrast, the increment in work associated with a force 
force / pushing a block a distance dx against a linear spring is an example of a 
differential form /• dx that is an exact differential (the potential function is 
u = \k{x • x) , where k is the spring constant. For the frictional block, the work 
accumulates in a path-dependent manner. For the spring, the work is path- 
independent (it only depends on the current value of x , not on all the values it might 
have had in the past). By the way, a spring does not have to be linear in order for a 
potential function to exist. The most fundamental requirement is that the force must 
be expressible as a proper function of position — always check this first. 



This expression is not really an equation. It is just a standard way of indicating that each f, func- 
tion depends on X , which means they each can be expressed as functions of x l and x 2 . 
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"There are a thousand hacking at the branches 
of evil to one who is striking at the root " 
— Henry Thoreau 

3. Matrix Analysis (and some matrix calculus) 

Tensor analysis is neither a subset nor a superset of matrix analysis — tensor analysis 
complements matrix analysis. For the purpose of this book, only the following concepts 
are required from matrix analysis:* 

Definition of a matrix 

A matrix is an ordered array of numbers that are arranged in the form of a "table" 
having TV rows and M columns. If one of the dimensions (N or M) happens to equal 1, 
then the term "vector" is often used, although we prefer the term "array" in order to 
avoid confusion with vectors in the physical sense. A matrix is called "square" if M=N. 
We will usually typeset matrices in plain text with brackets such as [A]. Much later in this 
document, we will define the term "tensor" and we will denote tensors by a bold symbol 
with two under-tildes, such as A . We will further find that each tensor can be described 
through the use of an associated 3x3 matrix of components, and we will denote the 
matrix associated with a tensor by simply surrounding the tensor in square brackets, such 
as [A] or sometimes just [A] if the context is clear. 

For matrices of dimension Nx 1 , we also use braces, as in {v} ; namely, if N=3 , then 



{v} 



(3.1) 



For matrices of dimension 1 x M, we use angled brackets <v> ; Thus, if M=3 , then 

<v> = [v 1 ,v 2 ,v 3 ] (3.2) 

If attention must be called to the dimensions of a matrix, then they will be shown as 
subscripts, for example, [A] MxN . The number residing in the z' th row and ;' th column of 
[A] will be denoted A tJ . 



* Among the references listed in our bibliography, we recommend the following for additional read- 
ing: Refs. 26, 23, 1 , 36. For quick reference, just about any Schaum's outline or CRC handbook 
will be helpful too. 
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Component matrices associated with vectors and tensors 
(notation explanation) 

In this book, vectors will be typeset in bold with one single "under-tilde" (for 
example, v) and the associated three components of the vector with respect to some 
implicitly understood basis will be denoted {v} or <v>, depending on whether those 
components are collected into a column or row matrix, respectively Similarly, second- 
order tensors (to be defined later) will be denoted in bold with two under-tildes (for exam- 
ple T). Tensors are often described in terms of an associated 3x3 matrix, which we will 
denote by placing square brackets around the tensor symbol (for example, [T] would 
denote the matrix associated with the tensor T). As was the case with vectors, the matrix 
of components is presumed referenced to some mutually understood underlying basis — 
changing the basis will not change the tensor T, but it will change its associated matrix 
[ T] . These comments will make more sense later. 

The matrix product 

The matrix product of [A ] M x R times [B] RxN is a new matrix [ C] M x N written 

[C] = [A][B] (3.3) 

Explicitly showing the dimensions, 

[CI = [A] [B] (3.4) 

MxN MxR RxN 

Note that the dimension R must be common to both matrices on the right-hand side of this 
equation, and this common dimension must reside at the "abutting" position (the trailing 
dimension of [A] must equal the leading dimension of [B] ) 

The matrix product operation is defined 

k= i 

where i takes values from 1 to M, 

and j takes values from 1 to N. (3.5) 



The summation over k ranges from 1 to the common dimension, R . Each individual com- 
ponent C-- is simply the product of the z' th row of [A] with the /' th column of [B] , which 
is the mindset most people use when actually computing matrix products. 



SPECIAL CASE: a matrix times an array. As a special case, suppose that [F] is 
a square matrix of dimension N x N . Suppose that { v} is an array (i.e., column matrix) of 
dimension N x 1 . Then 

{u} = [F]{v} (3.6) 



22 

Copyright is reserved. Individual copies may be made for personal use. No part of this document may be reproduced for profit. 



September 4, 2003 5:24 pm 

Matrix Analysis (and some matrix calculus) 



must be an array of dimension Wx 1 with components given by 

N 

Uj = V F ik v k , where i takes values from 1 to N (3.7) 

*= l 

SPECIAL CASE: inner product of two arrays. 

As another special case, suppose the dimensions M and N in Eq. (3.5) both equal 1. 
Now we are talking about the matrix product of two arrays. Then the free indices i and j 
in Eq. (3.5) simply range from 1 to 1 giving the result 

R 

IfM = 1 and TV = 1 , C n = ^A lk B kl (3.8) 

k= i 
When working with matrices with only one row or only one column, recall that explicit 
mention of the "1" in the index formulas is usually omitted. Also, lxl matrices (like the 
matrix [C] in this case) are typeset without showing any subscripts at all. Consequently 
this result would be written 

c= j^A k B k (3.9) 

*= i 
In other words, this array "inner product" simply sums over every product of correspond- 
ing components from each array. This array inner product is called the "dot" product in 3D 
engineering vector analysis. When {A } and {B} are arrays, this inner product will often 
be seen written using array notation as 

{A} T {B} or <A>{B) (3.10) 

SPECIAL CASE: outer product of two arrays. 

As a very different special case, suppose that the common dimension R equals 1 . Then 
the matrices in Eq. (3.5) again get treated and typeset as arrays instead of matrices but this 
time, the summation over R becomes trivial (there is only one term in the sum, so there 
isn't really a sum at all). Specifically 

If R = 1 , then Eq. (3.5) becomes simply 

C, = A, Bj 

where i takes values from 1 to M, 

and /* takes values from 1 to N . (3.11) 

Unlike the inner product which produces a single number, this "outer product" multiplies 
to arrays together to obtain a matrix. When {A} and {B} are arrays, this outer product 
will often be seen written using array notation as 

{A}{B} T or {A}<B> (3.12) 

EXAMPLE: Consider two arrays: 
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<u> = h _3 4I and <v> 

The inner product between { u } and { v } is 



[2 5 



(3.13) 



<u>{v} = [i _ 3 4] 



(l)(2) + (-3)(5) + (4)(-7) = -41 



(3.14) 



This also equals the inner product between { v } and { u } because the inner product is 
commutative. The inner product is just a single number. 

Now consider the outer product, which results in a full matrix and is not commutative. 
The outer product between { u } and { v } is 



{u}<v> 



[2 5 -7] 



(1)(2) (1)(5) (l)(-7) 
(-3)(2) (-3)(5) (-3)(-7) 
(4)(2) (4)(5) (4)(-7)_ 





2 5-7 


= 


-6 -15 21 




8 20 -28_ 



(3.15) 



The outer product between { v } and { u } is 



{v}<u- 



[l -3 4] 



(2)(1) (2)(-3) (2)(4) 
(5)(1) (5)(-3) (5)(4) 
(-7)(1) (-7)(-3) (-7)(4) 





2-6 8 


= 


5 -15 20 




-7 21 -28_ 



(3.16) 



Note that the resulting outer product matrices are not equal (they differ by a transpose), so 
the outer product is not commutative. Outer products play a pivotal role in tensor analysis 
because they are related to dyads, which are primitive kinds of tensors. The component 
arrays for the base vectors in vector analysis are 



<€i> 



<€ 2 > 



<€ 3 > 



[lOo] 
[OIO] 
[OOI] 



(3.17) 



Note that the inner product between a base vector and itself equals 1 , and the inner product 
between a base vector and any of the other two different base vectors equals zero. Later 
on, we will use the notation [e t e,] to denote the outer product, {£,}<£>, of the "z' th " 
base vector with the "y' th " base vector. The result will be that [e t e.] is a 3 x 3 matrix that 
has zeros everywhere except for a 1 in the ij location. For example, 



24 

Copyright is reserved. Individual copies may be made for personal use. No part of this document may be reproduced for profit. 



September 4, 2003 5:24 pm 

Matrix Analysis (and some matrix calculus) 



[€ 2 €il 



[? 3 ?J 



1 







1 






1 



[€lg 2 ] = 



tS 2 € 2 ] = 



[e 3 e 2 ] 



1 







1 







1 



[gi€ 3 ] = 



t€ 2 € 3 ] = 



[? 3 € 3 ] 



1 







1 







1 



(3.18) 



The Kronecker delta 

The Kronecker delta is a symbol 8 ■■ whose value depends on the subscripts i and /' . 
Specifically, 

\ * if i= J 
5-. = J (3.19) 

lJ [O if i*j 



The identity matrix 

The identity matrix, denoted [/] , has all zero components except 1 on the diagonal. 
For example, the 3x3 identity is 



M 



1 
1 
1 



(3.20) 



8 U 8 12 S 13 




1 


"21 "22 "23 


= 


1 


"31 "32 "33_ 




1 



The ij component of the identity is given by Kronecker delta, 8 ■ . That is, recalling 
Eq.(3.19), 



(3.21) 



Note that, for any array { v } 

MM = {v} (3.22) 

In component form, this equation is written 

3 

X 8,,v, = v t (3.23) 

k= 1 
This represents a set of three equations. The "free index" i takes the values 1, 2, and 3. 
By the way, referring to Eq. (3.18), note that 
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U\ = [€i€i] + [€ 2 € 2 ] + [€ 3 € 3 ] ( 3 - 24 ) 

Equivalently, note that 

3 3 

w = I I d iM& (325) 

! = 1/ = 1 

Derivatives of vector and matrix expressions 

Junior-high-school students learn about simple functions of a single variable such as 
y = x 2 or y = lnx or y = sinx . In calculus, they learn how to differentiate these func- 
tions. Eventually students begin working with functions (and even families of functions) 
of more than one variable such as y = ue w , s = u + w, and r = u/w . Differentiating 
functions of more than one variable requires the chain rule for partial differentiation. In 
physical applications, two or more of the independent variables might be so intimately 
related to each other (e.g., perhaps they are the three components of a velocity vector) that 
it works better to denote them by the same symbol distinguishing between them only by 
numbered subscripts, such as v l5 v 2 , v 3 . 

SIDEBAR (functional dependence structure rule). When working with a small number 
of variables, the structure y = f(x) is a conventional way to communicate to readers 
that y is a function of x. However, serious scientific research often requires simulta- 
neous processing of so many different variables that giving up a new letter of the 
alphabet (/) merely to indicate that y depends on x is not feasible. Consequently sci- 
entists frequently use the structure y = v(x) to mean "y is a variable that is express- 
ible as a function of x." Of course, if the focus of a discussion is aimed on the function 
itself (rather than on simply indicating dependencies), the function should be denoted 
by a symbol that differs from its output. Many times, you might see something like 
y = ,v(x) , but using the hat would preclude your using it to denote something else later 
on. Those of us who are running extremely short on available letters of the alphabet 
don't even want to add "hat" decorations or other diacritical marks to denote functions 
— we need the hats and other marks to denote additional distinct variables. 

In calculus classes, students learn that the chain rule may be used to find, say, the time 

derivative of a function y = y(x) to give y = -j-x , where the superimposed dot denotes 

the time rate. In more complicated applications, one must often deal simultaneously with 

families of variables that might themselves depend on some other family of independent 

variables. You might, for example, be working with a set of equations of the form 

y\ = J 1 (x 1 ,x 2 ,x 3 ) (3.26) 

y 2 = j 2 (x 1 ,x 2 ,x 3 ) (3.27) 

In this case, the time derivative is obtained via the chain rule to give 

^"© i ' + © i » + ©*3 (329) 
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SIDEBAR (structure rule for partial differentiation): Any derivative with respect to a 
member of a subscripted family of variables (in this case, x, , x, , and x 3 ), is under- 
stood to be taken holding the remaining members of that family constant. If a function 
depends additionally on other quantities, then the fact that they are being held con- 
stant must be noted explicitly by showing them as a subscript. If, for example, 
z = -z(xj, x 2 , x 3 , s, r, !/], u 2 , « 3 ) , the derivative of z with respect to x 2 would be written 



, where u is a shorthand "ensemble" representation for the three u k vari 
ablest '•■ « 



The use of subscripts to demark different variables is especially convenient because the 
above two equations can be written compactly as 

3 (dyh 

y i = VI — jXj , where the free index i takes values 1 and 2. (3.30) 

7=1 J 

Whenever you encounter a new function or transformation, it is a good idea to immedi- 
ately note the derivative of that function because you will undoubtedly later need it for 
rate equations. Consequently, throughout this book, we will often cite derivatives for any 
new function that we introduce. To illustrate, we will now discuss derivatives of sub- 
scripted quantities with respect to themselves. 

Derivative of an array with respect to itself 

"Everyone" knows that dx/dx = 1 . In other words, the derivative of a number with 
respect to itself equals unity* If y = x then dy/dx = 1 . What is the generalization of 
this statement for an array of numbers? Specifically, we have y = x , or written out in less 
cryptic (non-ensemble) form: 

y x = x x (3.31a) 

y 2 = x 2 (3.31b) 

y 3 = x 3 (3.31b) 

This relationship can be regarded as the identity transformation in which a three compo- 
nent array <y> identically equals another array <x> . 

Then, trivially, 

dy, dy, 

— = 1 — = 

dx j 5x 2 

dy dy 

dx j 8x 2 

dx j dx 2 

dyi 

This result can be written compactly as — = 8 

dx J J 

* The word "unity" is less snobbishly known as the number "one" or more snobbishly as the multipli- 
cative "identity". Actually "unity" is a better choice than "one" despite sounding pompous because 
phrases like "the result is one" leaves readers asking "one what?" 
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dy x 
3x 3 




(3.32a) 


dy 7 
ox 3 




(3.32b) 


8 Il = 1 

3x 3 




(3.32c) 


or, since y i : 


= *i> 





dx- 






= S- 


BXj 


y 


J 
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(3.33) 



This is the array analog of the scalar identity, dx/ dx = 1 . Later on, when we introduce 
direct structural notation, the above result will be written 



dx = r 

dx 



(3.34) 



Throughout this book, we will be defining various operations that take scalars, arrays, 
or matrices as input to construct some new scalar, array, or matrix as output. (The above 
trivial example was the identity operation. It took an array <x> and spit <x> right back 
out as output.) Knowing that derivatives of operations will eventually be needed, we will 
attempt to wrap up every discussion of new operations by giving you the expression for 
the function's derivative in both index and structured notation. The calculus machinery 
needed to prove the derivatives will not be discussed until Chapter 21 on page 251, so you 
should just consider the derivatives to be provided for future reference without proof. 

Derivative of a matrix with respect to itself 

Suppose we have an Nx M matrix [A ] . Performing an analysis similar to what was 
done above, we can assert that the derivative of A •• with respect to A mn (holding the other 
components constant) will be zero unless the subscripts on A tj are exactly the same as 
those on A mn , in which case the result would equal 1. In order for if to equal mn , you 
must have i=m and j=n . Therefore, we can assert that 




where i and m range from 1 to N 
andy and n range from 1 to M. 



(3.35) 



Later on, when subscripts always range from 1 to 3 for vectors and tensors, this result will 
be cast into a new (structured) notation as 



(3.36) 




where 8 will be shown to equal a fourth-order identity tensor. 



* To understand why we used "3 " in Eq. (3.33) but "d" in (3.34), see the discussion on page 266. 
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The transpose of a matrix 

The transpose of a matrix [A] is a new matrix [B] (note the reversed dimen- 

MxN NxM 

sions). The components of the transpose are 

B iJ = A Ji 

where i takes values from 1 to N, 

and / takes values from 1 to M . (3.37) 

The transpose of [A] is written as [A] T , and the notation Af means the ij component of 
[A ] T . Thus, the above equation may be written 

where i takes values from 1 to N, 

and /* takes values from 1 to M . (3.38) 

The dimensions of [A ] and [A ] T are reverses of each other. Thus, for example, if { v } is 
aniVx 1 matrix, then { v } r is a 1 xiV matrix. In other words, 

{v} T = <v> and <v> T = {v} (3.39) 

The transpose of a product is the reverse product of the transposes. For example, 

([A][B]) T = [B] T [A] T , a nd 

(<v>[A]) T = [A] T <v> T = [A] T {v} (3.40) 

Derivative of the transpose: 

BAT. 

z£ - 5 ^>- (341) 



rs 



The inner product of two column matrices 

The inner product of two column matrices, {v} and {w\ , each having the 

same dimension is defined 

{v} T {w} , or, using the angled-bracket notation, <v>{w} (3.42) 

Applying the definition of matrix multiplication, the result is a 1 x 1 matrix (which is just 
a single number) given by 

N 

X V k w k ( 3 -43) 

k= 1 
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If {v} and { w) contain components of two vectors v and w then the inner product gives 
the same result as the vector "dot" product v • w , defined later. Noting that the above rela- 
tionship treats the components of { v} and {w} in precisely the same way — the result is 
unchanged if these two arrays are swapped. However, the notation of Eq. (3.42) makes it 
look as though { v} and { w} play different roles because one of them has a transpose and 
the other does not. Thus, you might see use of alternative notations for the inner product 
that are more "equitable" looking such as 



N 



{v}*{w} = {w}*{v} = V 



v k w k 



(3.44) 



Here, the raised star (*) is being used as a new operator symbol — a structure. Later on, 
when dealing with vectors instead of arrays, we use a raised dot for the inner product (as in 
v • w). Many people like to use a raised dot to denote any inner product regardless of the 
nature of the operand, but we will use the raised dot only for inner products between vec- 
tors. Different symbols will be later defined for different kinds of operands. 

Derivatives of the inner product: The inner product is a binary operation (i.e., it 
has two arguments, {v} and {w} . Thus, we can discuss formulas for partial derivatives 
with respect to one argument, holding the other constant: 



8({v}*{w}) = _d_ 
dv : dv, 



N 



Y, V k W k 
\-k=\ 



N 



X 5 ki w k = w i 



(3.45) 



similarly, 






_d_ 

dw, 



N 



z 



v k w k 



k= 1 



N 



X V k 6 ki 



(3.46) 



*= 1 



In direct (structured) notation, this result will later be written as 



8(v • w) 

dv 



w 



and 



d(v • w) 
dw 



(3.47) 



As a special case, consider the case that both arrays are the same. In this case where 
{v} = {w} , it isn't possible to take the derivative with respect to {v} while holding 
{w} constant. Since { w} equals {v } } , it must vary whenever { v} varies, so let's work 
this one out from scratch: 



d({v}*{v|) = A 
dv ; dv, 



{ N 


\ 


I 


v k v k 


Vjfc=l 


J 



N 



£(8«v* + v*««) = 2v ; . (3.48) 

k= 1 

This result is analogous to the simple scalar equation dx 2 /dx = 2x . In structured vector 
notation, 
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d(v • v) . 
dv 



(3.49) 



To understand why we used "d" instead of "3" in this equation, refer to the "sidebar" on 
page 266. 

The outer product of two column matrices. 

The outer product of two column matrices, {a } and {b } , not necessarily of 

the same dimension is defined 

{a}{b} T , or, using the angled-bracket notation, {a }<b> (3.50) 

For this case, the value of the "adjacent" dimension R in Eq. (3.5) is just 1, so the summa- 
tion ranges from 1 to 1 (which means that it is just a solitary term). 

The result of the outer product is an M x N matrix, whose ij component is given by 
a { b- . If {a } and { b } contain components of two vectors a and b then the outer product 
gives the matrix corresponding to the "dyadic" product, qb (also often denoted a <8> b ), to 
be discussed in gory detail later. 



The trace of a square matrix 

A matrix [A] NxN is called "square" because it has as many rows as it has columns. 
The trace of a square matrix is simply the sum of the diagonal components: 



N 



tv[A] = p £ A 



kk 



(3.51) 



The trace operation satisfies the following properties: 
tx([AY) = trL4] 
tr([^][5]) = tr([5][^]) (cyclic property) 



(3.52) 
(3.53) 



Derivative of the trace. The trace of a matrix is a function of the matrix's compo- 
nents. If, for example, [A] is a 3 x 3 matrix, then 

tr[A] = A n +A 22 +A 33 (3.54) 

Therefore 



dtr[A] = u atr[il] = o, etc. 

dA n dA y 



(3.55) 



12 



Note that the derivative of [A] with respect to A-- equals 1 if i=j and if i ^j. This is 
precisely the definition of the Kronecker delta in Eq. (A.3.19). Thus, 




(3.56) 



31 

Copyright is reserved. Individual copies may be made for personal use. No part of this document may be reproduced for profit. 



September 4, 2003 5:24 pm 
Matrix Analysis (and some matrix calculus) 



This result holds regardless of the size of the matrix. In structured tensor notation, this 
result is written 

d\x[A\ 

-TT^- = I 0-57) 

dA 

Note the distinction between Eq. (3.56) and (3.35); in one case we are differentiating the 
trace of a matrix with respect to the matrix, while, in the other case, we are differentiating 
the matrix itself with respect to itself. In Eq. (3.56) the result is the second-order identity 
(two free indices), whereas, in Eq. (3.35), the result is the fourth-order identity (four free 
indices). 



The matrix inner product 

Given two matrices [A] and [B] of the same class (i.e., having the same 

.. • \ i . . M xN , . M xN, I-,, • • ,-1 

dimensions), the matrix inner product is a scalar obtained by summing terms in which 
each component of [A] multiplied by the corresponding component of [B] . Stated more 
explicitly, the matrix inner product (which we will denote using "*" as the operator sym- 
bol) is given by 

N M 
[A]*[B] = X Z A mn B mn (358) 

n = 1 m = 1 

Note that this is identical to 

[A]*[B] = tr([A][B] T ) = tr([A] T [B]) (3.59) 

Of course, if the second dimension TV happens to equal 1, then this matrix inner product 
becomes identical to the inner product defined in Eq. (3.44) for arrays. 

Later on, after we define what is meant by the term "tensor", we will find that ordinary 
engineering tensors can be described via 3x3 component matrices, in much the same 
way that a vector u can be described by a 3 x 1 component array. If [A] and [B] contain 
components of two second-order tensors A and B then the matrix inner product gives the 
same result as what we will later refer to as the tensor "double dot" product A:B , and the 
specialization of Eq. (3.58) using tensor notation is 



4''2 = Z Z A <nn B mn (3-60) 

n = 1 m = 1 

Just as the dot product u • v between two vectors tells you something about the angle 
between those vectors, the double-dot product between two tensors also tells about the 
degree of alignment between them. 

Derivative of the matrix inner product. In analog to Eqs. (3.45) through (3.47), 
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d(\A]*\B]) _ 
8A lJ v 


and 


d([A]*[B]) _ 


= A U 


d(A:B) 
* * - B 

ba 


and 


5(4 • B) 

— - — — = A 

8B 




In analog to Eq. (3.49), 








d(A:A) 

* * - 2A 









(3.61) 



(3.62) 



(3.63) 
dA 



Magnitudes and positivity property of the inner product 

The "magnitude" of a matrix* is given by 

\\[A}\\ = +J[A]*[A] (3.64) 

or 



IMI = JZ Z A mrAmn = Z Z ^^ (365) 

\m—\ V n = 1 m — 1 

Note that the positive square root must be taken. This equation is analogous to the ordi- 
nary scalar equation, |x| = +Jx 2 . Just as the operation Ju • u gives you the magnitude 
of a vector, the operation JA:A gives the magnitude of a tensor: 



J¥i = J Z Z 4 -^-» = Z Z ^»») 2 (3 - 66) 

= 1 #j = 1 V w = 1 m = 1 

Careful readers should be asking themselves: How can we be sure that we won't be 
trying to take the square root of a negative number? The answer is simple. Recalling our 
previous statement that all vectors, matrices, and tensors in this book are presumed to have 
real components unless otherwise indicated, you know that every term in the summation 
in Eq. (3.66) is the square of a real number!. Hence, the final result for the summation in 
Eq. (3.66) will not be negative. Taking the positive square root gives a positive real value 
for the tensor's magnitude. 



* Also called the L 2 norm. 



| When dealing with matrices whose components might be complex, the definition of the inner prod- 
uct needs to be modified to be [^4]*[5] = tr([^f] r [5]) , where the overbar denotes the complex con- 
jugate. When this modification is made, each term in the operation [A]* [A] becomes of the form 
A mn A mn which will be a nonnegative real number. The notation, [A] T , which represents the trans- 
pose of the conjugate (or, equivalently, the conjugate of the transpose) is commonly referred to as 
the "Hermitian" and is denoted [A ] H . Throughout this book, whenever you see a transpose opera- 
tion, it is likely that the equation will generalize to complex components by replacing the transpose 
with the Hermitian — this rule-of-thumb is not absolute, so you should always double check 
against fully developed complex linear algebra textbooks. 
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The ability to use the inner product to compute a magnitude of a tensor (or matrix) is 
pivotal in the very special and carefully crafted mathematician's definition of "inner prod- 
uct." Among the required properties of the inner product, the most important is positiv- 
ity, which says that the inner product of a matrix with itself must result in a positive 
number (or zero if and only if the matrix itself is zero). 

Derivative of the magnitude. By the chain rule, using Eq. (3.63), 

d IUa d{A:A) 112 , d(A:A) 

4^ =J^- ~ \ { ^ rV1 it L - - ^r ll2 4 (3-67) 

or 

d\\A\\ A 

(3.68) 



d 4 \\4\\ 

The version of this equation that applies to vectors is 

"T^ = rfTT (3-69) 

dv \\v\\ 

Physically, this shows that the derivative of the magnitude of a vector v with respect to the 
vector itself simply equals a unit vector in the direction of v . 

Norms. Let k be a real number. Consider the following summation in which each com- 
ponent of a matrix is raised to the power k , with the final result raised to the power 1 /k . 

( 3 3 \ xtk 



IIMII 



k 



vi = 1 m = 1 



(3.70) 



This expression is called the "L^-norm" of the matrix, and it applies to arrays (i.e., Mxl 
matrices) as a special case. Note that Eq. (3.65) is the L 2 norm. 

As k becomes larger in Eq. (3.70), the A mn components that are largest in absolute 
value compared to the other components become even larger relative to the other compo- 
nents when raised to large values of the k exponent. In the limit as k — > oo , the largest 
component of [A] "swamps out" all of the other components in the summation, so that 
after raising the sum to the power \/k, it can be shown that the "L^-norm" produces is 
given by the absolute value of this dominant component: 

ML = ma *\A mn \ (3.71) 

m, n 

Although this and the other L k norms are interesting and useful for matrix analysis, it 
turns out that they are not of much use in vector and tensor analysis. The reason revolves 
around a concept called "basis invariance." In vector analysis, the components of a vector 
v are frequently assembled into a 3 x 1 array <v l5 v 2 , v 3 >. The L^ norm of this array 
would be simply max(|v 1 |, IvJ, |v 3 |). However, the components of a vector depend on 
your choice of basis. The components of the same vector v will have different values with 



34 

Copyright is reserved. Individual copies may be made for personal use. No part of this document may be reproduced for profit. 



September 4, 2003 5:24 pm 

Matrix Analysis (and some matrix calculus) 



respect some other choice of basis. The max component in one basis will not generally 
equal the max component in a different basis, so we say that the L^ norm is not invariant 
under basis transformations for vectors. In general the only L k norm that does give the 
same result regardless of the basis used for vectors (and tensors) is the L 2 -norm. Hence 
for vector and tensor analysis, only the L 2 norm (or its weighted generalization described 
below) is of interest. 

Weighted or "energy" norms. Let [M] denote a square positive-definite NxN 
matrix.* Then the weighted or energy norm of any vector { v} is defined 

IMILrgy = |{v} r [M]{v} (3.72) 

The reason for the moniker "energy" should be clear because of the similarity that this 



equation has with the equation for kinetic energy -mv 1 for a single particle of mass 



m 



moving with speed v . As a matter of fact, the expression -mv 2 can be written in exactly 
the form of Eq. (3.72) by taking [M] = m[I] . In mechanics, the total kinetic energy of a 
rigid body is ^{co} r [0]{co}, where { co } contains the components of the angular veloc- 
ity vector and [O] is the rotational moment of inertia of the body about the axis of rota- 
tion, which can be proved to be positive definite. 

Note that ordinary L 2 norm of a vector is merely a special case of the more general 
weighted or energy norm of Eq. (3.72) obtained by setting [M] = 2[I] . Weighted norms 
can also be generalized to apply to matrices, as we will see in later discussions of material 
constitutive modeling. 

Derivative of the energy norm. In component form, Eq. (3.72) may be written 

N N 



= 1 

1 energy j 

i = \j = 1 



|v|1 — - = r Z Z v i M v v k < 3 - 73 ) 



from which it follows that 

N 
d(\\v\\ 2 ) 

^" energy; = Z M ks V s (3.74) 

s = 1 

The above equations apply to the square of the energy norm. The derivative of the energy 
norm itself is 

/ 2 N 

'A 1 1 v l I energy) _ °W H v Henergy ) _ 1 V W v ll 7^1 

Tv ~d~v llvll Z u M ks v s \3.I0) 

OV p OV k 1 1 "II energy " 

s = 1 



* By "positive definite" we mean it satisfies the condition that {a} T [W]{b} > for all N x 1 arrays 
{a} and {b} except, of course, arrays containing all zeros. See page 47 for details. 
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The 3D permutation symbol 

The 3D permutation symbol (also known as the alternating symbol or the Levi- 
Civita density) is defined 



e ijk 



1 if ijk= 123, 231, or 312 
-1 if ijk =321, 132, or 213 
otherwise 





For example, s 231 = l , e 213 =— 1 , and £ 2 12 = 0- Note that the indices on e jk may be per- 
muted cyclically without changing the value of the result. Furthermore, inverting any two 
indices will change the sign of the value. Thus, the permutation symbol has the following 
properties: 

e ijk = E jki = s kij = ~ & jik = ~ S ikj = ~ s kji ( 3 - 77 ) 

The term "3D" is used to indicate that there are three subscripts on e- k each of which take 
on values from 1 to 3.* 



The 8-5 (E-delta) identity 

If the alternating symbol is multiplied by another alternating symbol with exactly one 
index being summed, a very famous and extraordinarily useful result, called the s-S iden- 
tity, applies. Namely, 

3 

X e ijn e kln = M//" 8 .-/ 8 ./*- ( 3 - 78 ) 

n = 1 

Here, we have highlighted the index "«" in red to emphasize that it is summed, while the 
other indices (i,j, k, and /) are "free" indices taking on values from 1 to 3. Later on, we are 
going to introduce the "summation convention" which states that expressions having one 
index appearing exactly twice in a term should be understood summed over from 1 to 3 
over that index. Index symbols that appear exactly once in one term are called "free indi- 
ces," taking values from 1 to 3, and they must appear exactly once in all of the other terms. 
Using this convention, the above equation can be written as 

ZijnHln = §ik§jl-§ifijk- ( 3 - 79 ) 



Though not needed for our purposes, the 2D permutation symbol £, is defined to equal zero if i=j , 
+ 1 if i/=12 , and -1 if ij = 21 . The 4D permutation symbol z jjkt is defined to equal zero if any of 
the four indices are equal; it is +1 if ijkl is an even permutation of 1234 and -1 if ijkl is an odd 
permutation. A permutation is simply a rearrangement. The permutation ijkl is even if rearranging 
it back to 1234 can be accomplished by an even number of moves that exchange two elements at a 
time. A cyclic permutation of an «-D permutation symbol will change sign if n is even, but remain 
unchanged if n is odd. Thus, for our 3D permutation symbol, cyclic permutations don't change 
sign, whereas cyclic permutations of the 4D permutation symbol will change sign. 



36 

Copyright is reserved. Individual copies may be made for personal use. No part of this document may be reproduced for profit. 



September 4, 2003 5:24 pm 

Matrix Analysis (and some matrix calculus) 



Because of the cyclic properties of the permutation symbol, the 8-8 identity applies 
whenever any index on the first s matches any index on the second 8. For example, the 
above equation would apply to the expression s nj/ e kln because s ;! ■■ = s in . The negative 
of the s-5 identity would also apply to the expression s in e kln because s ■ ■ = -s ■ ■ 7 . Of 
course, if a negative permutation is also required to place the summation index at the end 
of the second s, then the positive of the s-8 identity would again apply 

To make an expression fit the index structure of Eq. (3.78), most people laboriously 
apply the cyclic property to each alternating symbol until the summed index is located at 
the trailing side on both of them. Keeping track of whether or not these manipulations will 
require changing the final sign of the right hand side of the s-8 identity is one of the most 
common and avoidable careless mistakes made when people use this identity. Even once 
the summation index has been properly positioned at the trailing end of each alternating 
symbol, most people then apply a slow (and again error-prone) process of figuring out 
where the free indices go. Typically people apply a "left-right/outside-inside" rule. By 
this, we mean that the free indices on the left sides of s ; - ■ and z kln are the indices that go 
on the first 8, then the right free indices go on the second 8, then the outer free indices go 
on the third 8, and (finally) the inner free indices go on the last 8. The good news is... you 
don't have to do it this way! By thinking about the s-8 identity in a completely differ- 
ent way, you can avoid both the initial rearrangement of the indices on the alternating 
symbols and the slow left-right-out-in placement of the indices. Let's suppose you want to 
apply the s-8 identity to the expression s /myt s • . First write a "skeleton" of the identity as 
follows 

Z imk Z pin = 8 ?? 8 ?? -8 ?? S ?? (3.80) 

Our goal is to find a rapid and error-minimizing way to fill in the question marks with the 
correct index symbols. Once you have written the skeleton, look at the left-hand side to 
identify which index is summed. In this case, it is the index i . Next say out loud the four 
free indices in an order defined by "cyclically moving forward from the summed index" on 
each alternating symbol. Each alternating symbol has two free indices. To call out their 
names by moving cyclically forward, you simply say the name of the two indices to the 
right of the summed index, wrapping back around to the beginning if necessary. For 
example, the two indices cyclically forward from "p" in the sequence "pqr" are 'V"; the 
two indices cyclically forward from "a" are "rp"; the two indices forward from "r" are 
"pq". For the first alternating symbol in the skeleton of Eq. (3.80), the two indices cycli- 
cally forward from the summed index i are "mk" whereas the two indices cyclically for- 
ward from i in the second alternating symbol are "np". You can identify these pairs 
quickly without ever having to rearrange anything, and you can (in your head) group the 
pairs together to obtain a sequence of four free indices "rnknp". The final step is to write 
these four indices onto the skeleton. If the indices are ordered 1234, then you should write 
the first two indices (first and second) on the skeleton like this 

8 1? S 2? — S 1? 82 ? (3-81) 
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You write the last pair (third and fourth) in order (34) on the first term and in reverse order 
(43) on the last term: 

5 13 5 24" 5 14 5 23 ( 382 ) 

Thus, for example, to place the free indices "mknp" onto the Kronecker deltas in Eq. 
(3.80), you would first take care of the "mk" by writing 

5 m? 5 £? " S m? S *? ( 3 - 83 ) 

Then you just finish off with the last two "np" free indices by writing them first in that 
order on the first term and in reverse order on the second term to obtain the final result: 

£ imk E pin = ^mn^kp-^mp^kn- ( 3 - 84 ) 

This may seem a bit strange at first (especially if you are already stuck in the left-right- 
outer-inner mind set), but this method is far quicker and less error-prone. Give it a try until 
you become comfortable with it, and you probably won't dream of going back to your old 
way. 

The 8-5 (E-delta) identity with multiple summed indices 

Recall that the 8-8 identity is given by 
3 

X s ijn E kln = M//" 8 */ 6 /*- ( 3 - 85 ) 

n = 1 

What happens if you now consider the case of two alternating symbols multiplied side-by- 
side with two indices being summed? This question is equivalent to throwing a summation 
around the above equation in such a manner that you add up only those terms for which 
/'=/. Then 

3 3 3 

Z Z E Vn £ kJn = Z (6 A" 5 yV) 

7=1k = 1 y = l 

= M 5 ll + 5 22 + 5 33) " ( d il d lk +d i2 d 2k +d i3 d 3k) 

= 36 ik~ 6 ik 

= 28,, (3.86) 

Note that we simplified the first term by noting that s n + 5 22 + 5 33 = l + l + l = 3 . The second 
term was simplified by noting that $ n 8 n + 5 ; . 2 5 2jfc + 8 a S u will be zero if i * k or it will equal 
1 if i=k . Thus, it must be simply 8^ . 

Using similar logic, the s-S identity with all indices summed is equivalent to setting 
i=k in the above equation, summing over each instance so that the result is six. To sum- 
marize using the summation conventions, 



e ijn e kjn 2d ik 



(3.87) 
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Bijfrjk = 6 



(3.88) 



Determinant of a square matrix 

The simplest way to explain what is meant by a determinant is to define it recursively. 
In this section, we show how the determinant of a 3x3 matrix can be alternatively 
defined by using the three-dimensional permutation symbol of Eq. (3.76). 

A 1 x 1 matrix is just a single number. The determinant of a 1 x 1 matrix is defined to 
equal its solitary component. Thus, 



det[A n ]=A n 
The determinant of a 2 x 2 matrix is defined by 



(3.89) 



det 



^11 ^12 
^21 ^22 



-A n A 22 A X1 A 1X 



The determinant of a 3 x 3 matrix is defined by 



(3.90) 



det 



^11 ^12 ^13 
A 2\ ^22 ^23 
^31 ^32 ^33 



(^11^22^33 +^12^23^31 + ^13^21^32) 

{A l3 A 22 A 3l + A n A 23 A 32 + A l2 A 2l A 33 ) 



(3.91) 



Note that we have arranged this formula such that the first indices in each factor are 123. 
For the positive terms, the second indices are all the positive permutations of 123. 
Namely: 123, 231, and 312. For the negative terms, the second indices are all the negative 
permutations of 123. Namely: 321, 132, and 213. This relationship may be written com- 
pactly by using the permutation symbol s ik from Eq. (3.76). Namely, if [A] is a 3 x 3 
matrix, then 



(3.92) 



This definition can be extended to square matrices of arbitrarily large dimension by using 
the A -dimensional permutation symbol (see footnote on page 36). Alternatively, for square 
matrices of arbitrarily large dimension, the determinant can be defined recursively as 





3 3 3 


detE4] = 


Z E Z £ ijk A li A 2j A 3k 




i=lj=lk=l 
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(no implied summation on index i ) 



(3.93) 



where i is a free index taking any convenient value from 1 to N (any choice for i will 
giv 

by 



give the same result). The quantity Afj is called the "cof actor" of A tj , and it is defined 



4 



(-iy+Mct[M lj]{N _ l)x{N _ 



1) 



(3.94) 



Here [M--] is the submatrix obtained by striking out the ? th row and / th column of [A] . 
The determinant of [M- ] is called the "minor" associated with A--. By virtue of the 
(-\) i+ J , the cofactor component Afj is often called the "signed minor." Further details 
about cofactors, including examples of how to compute them for 2 x 2 and 3x3 matrices 
are given on page 42. The formula in Eq. (3.93) is almost never used in numerical calcula- 
tions because it requires too many multiplications,* but it frequently shows up in theoreti- 
cal analyses. 

The index i in Eq. (3.94) may be chosen for convenience (usually a row with several 
zeros is chosen to minimize the number of sub-determinants that must be computed). The 
above definition is recursive because detE4] 



NxN 



is defined in terms of smaller 
(JV— 1 ) x (JV— 1 ) determinants, which may in turn be expressed in terms of 
(JV- 2) x (N— 2) determinants, and so on until the determinant is expressed in terms of 
only lxl determinants, for which the determinant is defined in Eq. (3.89). As an exam- 
ple, consider using Eq. (3.93) to compute the determinant of a 3x3 matrix. Choosing 
i— 1 , Eq. (3.93) gives 



dct 



A u A n A u 
A 2l A 21 A 23 
A n A i2 A i$ 



A ll det 



^22 ^23 
^32 ^33 



A l2 det 



A 21 A 23 
A n A $3 



A l3 det 



A 2i A 22 

^31 ^32 



(3.95) 



Alternatively choosing i=2 , Eq. (3.93) gives 



dct 



A 2l A 22 A 23 
^31^32^33 



-A 2l det 



^11 ^13 

^32 ^33 



A 22 det 



^11 ^13 
^31 ^33 



A 23 det 



A n A n 



(3.96) 



After using Eq. (3.90) to compute the 2x2 submatrices, both of the above expressions 
give the same final result as Eq. (3.91). 



* Specifically, for large values of the dimension TV, the number of multiplications required to evalu- 
ate the determinant using Crammer's rule (as Eq. 3.93 is sometimes called) approaches (e- l)N\ , 
where e is the base of the natural logarithm. An ordinary personal computer would require a few 
million years to compute a 20 x 20 determinant using Cramer's rule! Far more efficient decomposi- 
tion methods [_ J can be used to compute determinants of large matrices. 
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Some key properties of the determinant are listed below: 
det([A] T ) = detE4] 
det([A][B]) = (detM])(det[5]) 

det(a[A] NxN ) = c^det^] 
1 



det([^]-!) 



detE4] 



If [B] is obtained by swapping two rows (or two columns) of [A] 
thendet[5] = -detL4]. 



(3.97) 
(3.98) 
(3.99) 

(3.100) 
(3.101) 



If any row of [A] can be written as a linear combination of the other rows, then 

detE4]=0 . A special case is that detE4]=0 if any two rows of [A] are 

equal. (3.102) 



For 3x3 determinants, the last two properties allow us to generalize Eq. (3.92) to read 

3 3 3 

Z pq MW = X Z Z H^pi^rk ( 3 - 103 ) 

i=lj=lk=l 

or, using the summation convention in which repeated indices are understood to be 
summed (and, for clarity, now shown in red), 

z pqr fet[A] = s iJk A pi A qJ A rk (3.104) 

This expression is frequently cited in continuum mechanics textbooks as the indicial defi- 
nition of the determinant of a 3 x 3 matrix. Multiplying the above formula by s and 
summing over p q and r (and using Eq. 3.88) reveals that 



detE4] == ^ pqr A pi A qJ A rk e i j k 



(3.105) 



Here, there are implied summations over the indices i,j,k,p,q, and r. If it were expanded 
out, the above expression would contain 729 terms, so it is obviously not used to actually 
compute the determinant. However, it is not at all uncommon for expressions like this to 
show up in analytical analysis, and it is therefore essential for the analyst to recognize that 
the right-hand-side simplifies so compactly. 

Incidentally, note that 



e ijk Z pqr ^ et 



\ 


*« 


8/r 


^ 


^ 


h- 


6 kp 


5 kq 


hr 



(3.106) 
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If any two columns or rows are interchanged, the sign of this determinant is reversed, con- 
sistent with the cyclic property of the permutation symbol. Furthermore, if any two indices 
of ijk are equal, then two rows will be identical, making the determinant zero, again con- 
sistent with the definition of the permutation symbol. If, on the other hand, one of the three 
ijk indices is set equal to one of the three pqr indices, and the common index is summed 
from 1 to 3, then the 8-8 identity is recovered. 

More about cofactors 

Given a matrix [A] NxN , the cof actor matrix [A ] c is an N x N matrix whose com- 
ponents are obtained by application of the very strange formula that we first introduced in 
Eq. (3.94): 

A ?j = (- i y +Jd ^ M ij\N-l)x(N-l) ( 3 - 107 ) 

where (recall) [M- ■] is the submatrix obtained by striking out the z th row and / th column 
of [A] . The determinant of [M,,l is called the "minor" associated with A-- . The cofac- 
tor Ay- simply equals the minor times (-1 )' +J . 

It might seem that something with such an awkward definition would be of only lim- 
ited usefulness, but it turns out that cofactors are fantastically convenient and they appear 
frequently in practical physics applications (unless trained to look for cofactors, however, 
many people don't recognize them when they appear). As a rule of thumb: whenever you 
are analyzing a problem in which things are fluxing across or acting upon area elements 
that are stretching and rotating in time, "think cofactors." 

The remainder of this section illustrates how to compute cofactors in 2 and 3 dimen- 
sions, finishing with some derivative formulas involving cofactors. 



SIDEBAR: cofactors of a 2 x 2 matrix 



Consider a 2 x 2 matrix, 



A n A n 
A 21 A 21 



. To find the minor associated with A u , you strike 



out row 1 and column 1, and take the determinant of what's left. For a 2 x 2 matrix, 
the only thing left is pretty trivial — it's just the A 22 component. The determinant of 

a single number is just that number, so the minor associated with A j j is just A 22 ■ The 
cof actor, which is the signed minor found by multiplying by (-1) 1 + ' = l . Thus, 
A n = ^22 for a 2 x 2 matrix. The minor associated with A 12 is found by striking out 

row 1 and column 2 and taking the determinant of what's left which is just A 2l . The 
cofactor is found by multiplying this minor by (-1) 1 + 1 = -l to obtain Af 2 = -A 2l . 
Proceeding onward for each component eventually gives 

AC = A A c = -A 

A i\ = ~ A n A ii = A \\ These apply to a 2x2 matrix only! (3.108) 
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SIDEBAR: cofactors of a 3 x 3 matrix 



Consider a 2 x 2 matrix, 



A n A u A n 

A 2l A 22 A 23 
A n A 32 A 33 



To find the minor associated with A n , you 



strike out row 1 and column 1, and take the determinant of what's left, namely the 



2x2 matrix 



^22 ^23 
^32 ^33 



which has determinant ^22^33 -^32^23 • The cofactor, which is 



the signed minor, is found by multiplying this result by (-1) 1 + ' = 1 . Thus, 
A u = ^22^33 -^32^23 • F° r index structure pattern recognition (discussed below), we 
will write this result in an equivalent form with the factors in the last term swapped 
so that A pj 






22^33 



"^23^32 • The minor associated with A l2 is found by striking out 
row 1 and column 2 and taking the determinant of the remaining 2x2 matrix 

to obtain A 2l A i3 -a 31 a 23 . The cofactor is found by multiplying this minor by 



A 2l A 23 
A 3l A 33 



(_i)i + 2 = _i to obtain Af 2 = a 31 a 23 -a 21 a 33 , which we will write equivalently as 
A n = A n A i\ - A 2\ A a • Proceeding onward for each cofactor eventually gives 

4C = A A 



A n A 22 A J3 A 23 A 32 

A 2\ = A 7,2 A \7,~ A ^ A \2 

AC — A A _ A A 

A S\ A Yl A ll ^13^22 



A u A 23 A 3l A 2l A 33 



A 22 



A 33 A n A 3i A u 



^23 



i 21 yi 32 A 22 A 3i 
A 7,l A \2~ A i2 A \\ 



A 32 A \i A 2\ A \\ A 2Z 



iC — A A 



-A , ~,A~ 



(3.109) 



These apply to a 3 x 3 matrix only! 



The index structure of these cofactors can be expressed in the form 



mn mn mn mn mn 



Applies to a 3 x 3 matrix only! (3.11 0) 



Here, an overbar on an index indicates a cyclic step forward and underbar indicates a 
cyclic step backward. Specifically, 

if m = 1 , then m=2 and m=3 
if m = 2 , then m=3 and m=\ 
if m = 3 , then m=\ and m=2 (3.111) 

Finally, for 3 x 3 matrices, cofactor components may be expressed in terms of the 
permutation symbol as follows 



AC = I p p A A 

U 2 ipr ^jq s^p q^rs- 



(3.112) 



where, for compactness, we have used implicit summation conventions. 



Co1 'actor-inverse relationship. The cofactor matrix [A] c is well-defined even [A] 
is singular. If, however, [A ] happens to be invertible, then 
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[A] c = (det[^])[^]- r (3.113) 

This identity will be later discussed in more detail in the tensor analysis chapters. 

Derivative of the cof actor. For a 3 x 3 matrix [A], differentiating Eq. (3.112) gives 

8A C 3 3 

^=H *irmKn*n jS ( 3 - 114 ) 

m — 1 n — 1 

Derivative of a determinant (IMPORTANT) 

The determinant of a matrix [A ] is computed from the components of [A ] . Hence, the 
determinant may be regarded as a function of these components. Here we want to compute 
the derivatives of det[^4] with respect to any individual component of [A] , while holding 
the other components constant. 

Consider, for example, a 2 x 2 determinant. Derivatives of Eq. (3.90) with respect to 
individual components gives. 

g(det[^] 2x2 ) _ 5(det[^] 2x2 ) _ 

~dA 22 8A 21 

wct^w _ _ An d miA hx2) = Aii (3115) 

OA ■y i OA ■yy 

The formulas are different for a 3 x 3 matrix. Specifically, differentiating Eq. (3.91) with 
respect to each individual component gives 

S(det[^] 1x ,) 9(det[^], x1 ) t , n AA ~ 

V L Jixi ' = A A _A A L '5*5' = A A _A A pfp fi URN 

^22^33 ^23^32' qj ^23^31 ^21^33' CL ^- (0.\\V) 

Comparing Eq. (3.115) with (3.108) and comparing (3.116) with (3.110) show that, 
regardless of the size of the matrix, the derivative of a determinant with respect to a matrix 
is given by the cofactor! 

^MdJi = A C ( 3.H7) 

8A ij 

Frequently, the structure \A\ is used as a streamlined alternative to the notation 
det[v4] , in which case this result would be written 



, where \A\ = det[A] (3.118) 




Though we have only proved it for the special cases of 2 x 2 and 3x3 matrices, this 
result holds regardless of the dimension of [A]. This result is valid even if the matrix [^4] 
is singular. If, however, [A ] happens to be invertible, then the above result may be written 



, when [A ] is invertible (3.119) 
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Here, A.T denotes the ij components of the inverse of the transpose (or, equivalently, the 
transpose of the inverse) of [A] . Inverses and transposes are discussed soon. 

Rates of determinants. Whenever you need the derivative of a determinant with 
respect to something other than an individual component of the matrix, you should still 
nevertheless start with Eq. (3.118), and then apply the chain rule. In continuum mechan- 
ics, for example, material motion is characterized through the use of a tensor called the 
deformation gradient, which has a component matrix denoted [F] . The "Jacobian" is 
given by J = det[F] and, physically, it represents the ratio of deformed to undeformed 
volume of a material element. For dynamic problems, it is often desirable to know the 
time derivative of the Jacobian because it characterizes the volumetric expansion or con- 
traction rate. If J is a function of time t, then it follows that the components of [F] must 
be functions of time, so we can apply the chain rule of partial differentiation. 



dJ = _8J_^£u + _dJ_^j2 + dJ dF zi 

dt 8F U dt 8F n dt '" aF 33 dt 



(3.120) 



We now know that the derivative of a determinant with respect to a component is given by 
the cofactor for that component. Hence, this may be written 

r i i dF,, dF,-, dF-,, 

££ = F<=.— ii + J?£— 2+...+FG.— * (3.121) 

dt n dt n dt 33 dt K ' 

or, employing the popular alternative notational structure in which a superposed single dot 
denotes time differentiation, 

j = F? 1 F n +FC 2 F n+ ...+FgF 33 (3.122) 

or 

3 3 

'■ = 1/ = 1 

Recognizing that this expression is the matrix inner product, we may write 

J = [F] C *[F] (or, in tensor notation, J = F C :F) (3.124) 

If [F] is invertible (which it indeed is for deformation gradients), then this result may be 
written 

3 3 3 3 3 3 

J = ^Z I F f p ij = J Z Z F Ji p ij = J Z I VJi < 3 - 125 ) 

i = 1/ = 1 i = \j =1 i = \j = 1 

or 

J = JtrdF^F]- 1 ) (or, in tensor notation, J = J tx{F:F~ 1 )) (3.126) 

This result holds for any matrix [F] even though we have here described it using the 
deformation gradient as an example. 
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Derivatives of determinants with respect to vectors. Suppose that 

J = det[F] is to be differentiated with respect to an array { v} . Again, Eq. (3.118) is the 
place to start in conjunction with the chain rule. 



8J = dJ&Jji = F c 8 Jjf 

8v k 8F (J 8v k 'J 8v k 



(3.127) 



where, we are here using implicit summation over the indices i and / . If [F] is invertible, 
then this result may be written 



SJ_ = j f -t 8 Jji 

dv k V dv k 



(3.128) 



Principal sub-matrices and principal minors 

A so-called n x n principal submatrix of a square matrix [A] NxN is any n x n subma- 
trix (where n<N) whose diagonal components are also diagonal components of the 
larger matrix. For example, 



^11 ^13 
^31 ^33 



(3.129) 



is a principal submatrix, whereas 12 13 is not a principal submatrix. For a 3 x 3 matrix, 

A A 

there are three lxl principal submStriSes (identically equal to the diagonal components), 
three 2x2 principal submatrices, and only one 3x3 principal submatrix (equal to the 
matrix [A] itself). 

A sequence of lxl, 2x2,... tvx n submatrices is nested if the l x i matrix is a sub- 
matrix of the 2x2 matrix, and the 2x2 matrix is a submatrix of the next larger submatrix, 
and so forth. 

A principal minor is the determinant of any principal submatrix. The term "nested 
minors" means the determinants of a set of nested submatrices. 



Matrix invariants 

The k th "characteristic" invariant, denoted I k , of a matrix [A] is the sum of all possi- 
ble k x k principal minors. For a 3 x 3 matrix, these three invariants are 



^11 + ^22 +^33 



(3.130a) 



det 



A n A n 

A 2l A 22 



+ det 



^11 ^13 
^31 ^33 



+ det 



A 22 A 23 

^32 ^33 



(3.130b) 
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det 



A n A n A u 

A 2l A 22 A 23 

^31 ^32 ^33 



(3.130c) 



Warning: if the matrix is non-symmetric, the characteristic invariants are not a complete 
set of independent invariants. If all three characteristic invariants of a symmetric matrix 
are zero, then the matrix itself is zero. However, as discussed later, it is possible for all 
three characteristic invariants of a non-symmetric matrix to be zero without the matrix 
itself being zero. 

Derivatives: (without proof) 

dL 

1 — s 



Mm 

dA m 



= j 5 -A = / 8 -A T 

I mn nm 1 mn mn 



AC 

mn 



(3.131) 



(3.132) 



(3.133) 



Alternative invariant sets. As will be discussed throughout this book, the above 
three invariants are not the only invariants. Check "invariant" in the index for details. 



Positive definite 

A square matrix [B] NxN is positive definite if and only if 

{v} T [B]{v}>0 for all {v} 
In indie ial notation, this requirement is 

N N 

i = ij=i 
Written out explicitly for the special case of a 2 x 2 matrix 

i?ll V l V l + B l2 v \ v 2 + ^21 V 2 V 1 + ^22 V 2 V 2 > ^ 



(3.134) 



(3.135) 



(3.136) 
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Note that the middle two terms can be combined and written as i( u 21 jv 2 v 1 . Similarly, 
you can write the first term as 2[ — ^— — -J . The third term can also be so written. Thus, the 
requirement for positive definiteness depends only on the symmetric part of the matrix 
[B] . The non-symmetric part has no influence on whether or not a matrix is positive defi- 
nite. Consequently, you may replace Eq. (3.134) by the equivalent, but more carefully 
crafted, statement: 



[B ] is positive definite if and only if { v } T [A ] { v } > for all { v } , where [A ] is the 
symmetric part of [B] . 



It can be shown that a matrix is positive definite if and only if the characteristic invari- 
ants of the symmetric part of the matrix are all positive.* 

Fortunately, there is an even simpler test for positive definiteness: you only have to 
verify that any nested set of principal minors are all positive! This calculation is easier 
than finding the invariants themselves because it requires evaluation of only one principal 

minor determinant of each size (you don't have to evaluate all of them). See page for 

further details. 

The cofactor-determinant connection 

Let [A] c denote the matrix of cof actors Ajj associated with a square matrix 
[A] NxN . The transpose of the cofactor matrix is also sometimes called the adjugate 
matrix (not to be confused with "adjoint"). Recall the definition of the cofactor given in 
Eq. (3.94): 

By virtue of Eq. (3.97), note that the transpose of the cofactor matrix is identically 
equal to the cofactor matrix associated with [A] T . In other words, the cofactor and trans- 
pose operations commute: 

([A]Cf = ([A] T ) C (3.138) 

As a short hand, we generally eliminate the parentheses and simply write [A ] CT to mean 
the transpose of the cofactor (or, equivalently, the cofactor of the transpose). The generali- 
zation of Eq. (3.93) is 



It is possible to construct a matrix that has all positive invariants, but whose symmetric part does 
not have all positive invariants. 



48 

Copyright is reserved. Individual copies may be made for personal use. No part of this document may be reproduced for profit. 



September 4, 2003 5:24 pm 

Matrix Analysis (and some matrix calculus) 



N r 

E! if i ' ^ j 

A ik Ag = J (3.139) 

lk Jk detL4] if i=j 

k=\ 

Written more compactly, 

N 

^A lk AC = dQt[A]8ij (3 . 140) 

k= l 
Written in matrix form, 

[A][A] CT = (det[A]) [I] (3.141) 

It turns out that the location of the transpose and cofactor operations is inconsequential — 
the result will be the same in all cases. Namely, 



[A][A] CT = [A] C [A] T = [A] T [A] C = [A] CT [A] = (detL4]) [I] 



(3.142) 



Inverse 

The inverse of a matrix [A] is the matrix denoted [A]' 1 for which 

[A][A]~l = [A]~ l [A] = [I] (3.143) 

If the inverse exists, then it is unique. If the inverse does not exist, then the matrix [A] is 
said to be "non-invertible" or "singular." A necessary and sufficient condition for the 
inverse to exist is that the determinant must be nonzero: 

det[^] ^ (3.144) 

Comparing Eqs. (3.142) and (3.143), note that the inverse may be readily computed 
from the cofactor by 

[A]- 1 = MJ — (3.145) 

L J det[^] K ' 

While this definition does uniquely define the inverse, it must never be used as a definition 
of the cofactor matrix. The cofactor matrix is well-defined and generally nonzero even if 
the matrix [A ] is singular. 

Eigenvalues and eigenvectors 

As mentioned in Eq. (3.92), a nonzero vector (array) {p} is called an eigenvector of a 
square matrix [A ] if there exists a scalar X , called the eigenvalue, such that 
\A ] {p } = X{p} . In order for this equation to have a non-trivial (nonzero) solution, the 
determinant of the matrix [A] - X[I] must be zero. Setting this determinant to zero results 
in a polynomial equation, called the characteristic equation, for X. If [A] is a 2 x 2 
matrix, the equation will be quadratic. If [^4] is a 3 x 3 matrix, the equation will be cubic, 
and so forth. We highly recommend that you do not construct the matrix [A ] — X [I] and 
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then set its determinant equal to zero. While that would certainly work, it allows for too 
many opportunities to make an arithmetic error. Instead, the fastest way to generate the 
characteristic equation is to first find all of the characteristic invariants of [A] . These 
invariants are the coefficients in the characteristic equation, alternating sign, as follows 



For [A] 2 x 2 , the characteristic equation is 
0, 



X 2 - I{X + I 2 



where I x = A n + A 22 , and i 2 



dot 



A u A n 

A 2l A 22 



(3.146) 



For [A] 3 x 3 , the characteristic equation is 
X 3 -I l X 2 +I 2 X-I 3 = 0, 
where I x = A n + A 22 + A 33 , 



det 



J 3 = det 



A n A n 
A 2l A 22 



det 



^31 ^33 



det 



A 22 A 23 
A 32 A 3i 



A u A n A ]3 
A 2l A 22 A 23 

^31 ^32 ^33 



and 



(3.147) 



For [^] 4x4 , the characteristic equation is X 4 - I^X 3 + I 2 X 2 - I 3 X + 1 4 = 0. Higher 
dimension matrices are similar. 

Because the characteristic equation is a polynomial equation, an N x N matrix will 
have up to N possible eigenvalues. For each solution X { there exists at least one corre- 
sponding eigenvector {/?}.-, which is determined by solving 



\A ] {P } i = \ {P } ,• ( n ° sum ° n ' )■ 



(3.148) 



The solution for { p } . will have an undetermined magnitude and, for symmetric matrices, 
it is conventional to set the magnitude to one. For non-symmetric matrices, however, the 
normalization convention is different, as discussed in relation to Eq. (15.44). 

If an eigenvalue X i has algebraic multiplicity m (i.e., if the characteristic equation 
gives a root X t repeated m times), then there can be no more than a total of m indepen- 
dent eigenvectors associated with that eigenvalue — there might be fewer (though there is 
always at least one). If the matrix [A] is symmetric, then it is well known [1] that it is 
always possible to find m independent eigenvectors. The directions of the eigenvectors 
when the multiplicity m is greater than one are arbitrary. However, the one thing that is 
unique is the span of these vectors (see page 17), and it is conventional to set the eigen- 
vectors to any orthonormal set of vectors lying in the span. For non-symmetric matrices, it 
might happen that an eigenvalue of multiplicity m corresponds to a total of \i < m linearly 
independent eigenvectors, where n is called the geometric multiplicity. For example, the 
matrix 
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5 3 
5 



(3.149) 



Has an eigenvalue X = 5 with algebraic multiplicity of two. To find the associate eigen- 
vectors), you must solve 



(3.150) 



5 3 
5_ 


P\ 
Pi 


= 5 


Pi 
Pi 



Multiplying this out gives 
5p 2 = 5p 2 



(3.151) 



(3.152) 



The second equation gives us no information, and the first equation gives the constraint 
that p 2 = . Therefore, even though the eigenvalue had algebraic multiplicity of two, you 
have only one eigenvector (geometric multiplicity equals one) which is given by {1,0}. 
When the geometric multiplicity of an eigenvector is less than the algebraic multiplicity, 
then there does still exist a subspace that is uniquely associated with the multiple eigen- 
value. However, characterizing this subspace requires solving a "generalized eigenprob- 
lem" to construct additional vectors that will combine with the one or more ordinary 
eigenvectors to form a set of vectors that span the space. The process for doing this is 
onerous, and we have not yet personally happened upon any engineering application for 
which finding these generalized eigenvectors provides any useful information, so we will 
not cover the details. Instructions for the process can be found in [23,22,26]. If the gener- 
alized eigenvectors are truly sought, then they can be found via the "jordanDecomposi- 
tion" command in Mathematica [27] (see discussion below to interpret the result). 

Similarity transformations. Suppose that you have a set of eigenvalues 
{A-j, X 2 , •••, X N } for a matrix [A] , possibly with some of these eigenvalues having alge- 
braic multiplicities greater than one. Let [L] denote the matrix whose columns contain the 
corresponding eigenvectors (augmented, where necessary, to include generalized eigen- 
vectors for the cases where the geometric multiplicity is less than the algebraic multiplic- 
ity; the ordinary eigenvectors corresponding to a given eigenvalue should always, by 
convention, be entered into columns of [L] before the generalized eigenvectors). Then it 
can be shown that the original matrix [A ] satisfies the similarity transformation 



[A] = [L][A][L]- 



(3.153) 



If there are no generalized eigenvectors contained in the matrix [L] , then the matrix [A] 
is diagonal, with the diagonal components being equal to the eigenvalues. In this case, the 
original matrix [A] is said to be "diagonalizable." If, on the other hand, [L] contains any 
generalized eigenvectors, then [A] still contains the eigenvalues on the diagonal, but it 
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additionally will contain a "1" in the k—\,k position (i.e., a "1" just above the eigenvalue 
in the £ th column) corresponding to each £ th generalized eigenvector. In this form, the 
matrix [A] is said to be in Jordan canonical form. For example, the similarity trans- 
formation corresponding to Eq. (3.149) is 



(3.154) 



This result can be obtained in Mathematica [27] via the command JordanDecomposi- 
tion[{{5,3}, {0,5}}]. The presence of the "1" in the 12 position of the [A] matrix 
implies that the second column of [L] must contain a generalized eigenvector. 

A matrix [A] is "diagonalizable" if the [A] matrix has no "Is" on any off-diagonal. 
Consequently, there are no generalized eigenvectors. In general, even though [A] is diag- 
onal, that does not mean that [A] is symmetric. 

The matrix [L] will be orthogonal (i.e., [L]~ x = [L] T ) if and only if the original 
matrix [A] is symmetric. For symmetric matrices, there will never be any generalized 
eigenvectors (i.e., the algebraic and geometric eigenvalue multiplicities will always be 
equal), and the [A] matrix will therefore always be fully diagonal (no "1" on any off- 
diagonal). 

Finding eigenvectors by using the adjugate 

Recall that {p} is an eigenvector of [A] if [A]{p} = \{p} , where X is the eigen- 
value. This equation can be written 

[B]{p} = 0, where [B] = [A]-X[I] (3.155) 

Recall that we determined the eigenvalue by setting det[5] = . You can likewise use 
the [B] matrix to determine the eigenvectors. Given that the determinant of [B] is zero, 
Eq. (3.142) tells us that 

[B][B] CT = 0, (3.156) 

from which it follows that if there is any nonzero column of the adjugate matrix, [B] CT , 
then that column must be an eigenvector of [B] associated with the eigenvalue that was 
used to construct [B] in Eq. (3.155). It turns out that, for distinct eigenvalues (i.e., ones 
with multiplicity of 1), there will always be a non-zero column of [B] CT , and therefore 
the adjugate matrix is a slick and easy way to find the eigenvector. Unfortunately, the situ- 
ation is not so great when the eigenvalue is a double (or higher) root. For eigenvalues of 
multiplicity greater than one, it is still true that any nonzero column of [B] CT will be an 
eigenvector, but the adjugate might turn out to be zero or it might not capture all of the 
possible eigenvectors. Consider, for example, 



[A] = 



1 





(3.157) 



For the eigenvalue X = 1 , the "B" matrix is 
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[B] = 















-1 











-1 



for which the adjugate is [B] 



CT 



1 





, and therefore the 



eigenvector is the only nonzero column, 



(3.158) 



However, for the double root eigenvalue, X = , the "B" matrix is just [A] itself, and the 
adjugate is the zero matrix. Lacking nonzero columns, this adjugate matrix gives us no 
guidance to determine the eigenvector, and traditional methods must instead be used. Our 
recommendation is: use the adjugate to compute eigenvectors associated with distinct 
non-multiple eigenvalues, but don't bother when the eigenvalue is a multiple root. 



Eigenprojectors 

Recall Eq. (3.153): 

[A] = [L][A][L]~ l (3.159) 

Let's consider only the case that [A] is diagonalizable so that [A] is diagonal. Recall that 
each column of [L] contains an eigenvector. Let {g} k , called the left-eigenvector, denote 
the k th column of [L] (i.e., the k th eigenvector). Let <G> k , called the right-eigenvector, 
denote the k th row of [Z]" 1 . Since [LY l [L] = [I] , it follows that 



<G>i{8h = S,v 



(3.160) 



>J u 

This equation states that the inner product of different left and right eigenvectors will be 
zero and the inner product of corresponding left and right eigenvectors will equal unity. 
This property is called duality. 

For the moment, consider the case that all eigenvalues are distinct. The outer product 
of the left eigenvector {g} k with its own counterpart right eigenvector <G> k will pro- 
duce a square matrix, which we will denote [P] k and refer to as the k th eigenprojector: 

[P] k ={g}k <G> k (no sum on £) (3.161) 

An easy way to compute the eigenprojector [P] k is 

[P] k = [L][Q k [L]-l (3.162) 

where [C,] k is a matrix that has a 1 in the kk component and zeros everywhere else. Note 
that 



Eh 



(no sum on A:) (3.163) 



ttUQ k 

Consequently, 

{P\IP\ = iP\ 

As will be discussed in great detail later, this property implies that the tensor \_P\ is a pro- 
jection operator. It can be shown that the original tensor [A] can be expressed as a sum of 
its eigenvalues X k times the corresponding eigenprojectors [P] k : 



(no sum on A:) (3.164) 
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[A] = ^X k [P] k (3.165) 

k 
The summation ranges over the number of eigenvalues. The importance of this result will 
be far more clear when we get into tensor analysis. The term "eigenprojector" is used 
because each matrix [P] k can be regarded as a special operator that will project an arbi- 
trary array {v} into its part in the direction of the k th eigenvector. The projection is 
oblique if the original matrix [A] is non-symmetric. All of this will be more clear after 
you read about projection tensors later on. 

Recall that we temporarily discussed eigenprojectors under the assumption that the 
eigenvalues were all distinct. When there are repeated eigenvalues, the same results still 
apply except that the index k in Eqs. (3.162) through (3.165) now ranges over the number 
of distinct eigenvalues and the tensor [Q k is now zeros everywhere except a 1 in each 
location occupied by the k th eigenvalue in the [A] matrix. Thus, for example, a double 
root will have two entries of 1 on the diagonal. When there are double root eigenvalues, 
the associated eigenvectors are not unique, but their span is a unique plane. In this double 
root case, [P] k represents an operation that will project any vector onto that plane. Even 
though the eigenvectors are not unique, the eigenprojector is unique. 

Finding eigenprojectors without finding eigenvectors. The eigenprojectors 
are truly the physically significant results of an eigenvalue analysis because they are 
unique (individual eigenvectors are not unique when there are repeated eigenvalues). You 
can construct the eigenprojector without ever having to obtain the eigenvectors by the fol- 
lowing formula: 

in 

i = 1 

n <**-*•*) 

i = 1 
i*k 

Here, m is the total number of distinct eigenvalues. For matrices of small dimensions, this 
formula can be quite useful because it eliminates the need to compute eigenvectors. 
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"When two men in business always agree, one of 
them is unnecessary." — William Wrigler, Jr. 

4. Vector/tensor notation 

"Ordinary" engineering vectors 

We use the term "ordinary" to indicate the notion of a vector as it is introduced in ele- 
mentary calculus texts — namely, something in 3D physical space that has length and ori- 
entation. Physical examples include velocity, electric field, and angular rotation. This 
"definition" is horribly ambiguous, but it is adequate for reviewing basic concepts and we 
promise to atone for this transgression later. In general, we use the term "engineering" 
whenever a quantity is defined from a physical rather than mathematical perspective. A 
more correct mathematician s definition of the term "vector" can be found on page 227, 
where we will also introduce abstract vectors in higher-dimensional spaces. 

Engineering "laboratory" base vectors 

Let {e { ,e 2 ,e 3 } denote a set of mutually perpendicular vectors of unit magnitude, 
which we will refer to as the "laboratory basis" or the "laboratory triad." Elemen- 
tary calculus books often denote these vectors by {i,j, k} , but practicing researchers just 
can't spare that many letters of the alphabet. The unit base vectors are always presumed to 
exist as a reference from which all directional quantities may be described. The orientation 
of the laboratory triad should be regarded as mutually agreed upon by all observers (e.g., 
all observers might agree that they point in the same directions as the edges of the walls 
and floor in one corner of their laboratory, or they might define the directions based on the 
stars — it doesn't really matter what the choice is, so long as everyone agrees on it). The 
laboratory base vectors are presumed to be fixed in time and space. 

Other choices for the base vectors 

We insist that the laboratory basis must exist and all observers must agree upon its def- 
inition. However, other bases can be used as well. Different observers can, if they wish, 
opt to use supplemental basis triads. All observers will be able to communicate effectively 
with each other by transforming their own results into equivalent results expressed using 
the commonly agreed-upon lab basis. The rules governing how to accomplish these trans- 
formations from one basis to another are central to the study of vector and tensor analysis. 
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When explaining the meanings of various vector and tensor operations, this book lim- 
its its scope to definitions that apply only to mutually perpendicular vectors, each of unit 
magnitude. We also require that the orthonormal triad be "right-handed" (i.e., crossing the 
first lab base vector into the second one gives the third one ). Any basis that is both right- 
handed and orthonormal is called regularized. All vector and tensor operations pre- 
sented in this book apply only to regularized bases; generalized definitions that apply to 
irregular and curvilinear bases are provided in a sequel book [6]. 

Basis expansion of a vector 

Let v be an ordinary vector (like velocity or electric field). Its expansion in terms of an 
orthonormal basis {e v e 2 ,e 3 } is 



v = v, e, + v 9 £t + v~,e~, = 



'1S1 ' "2E2 



3S3 



= Z v <e<- 



(4.1) 



i= 1 



where v t are called the components of the vector with respect to the basis. The zero 
vector is defined to be the vector whose components are all zero. 

We may arrange the components of a vector in a column matrix as 



{v} 



and the expansion of Eq. (4.1) is analogous to writing 



v l 




1 












v 2 


= v \ 





+ v 2 


1 


+ v 3 





_ V 3 














1 



We may alternatively arrange the components of a vector into a row matrix: 



<v> 



V l V 2 V 3 



The row representation is just the transpose of the column representation: 



(4.2) 



(4.3) 



(4.4) 



{v} r =<v>, (4.5) 

However there is no such thing as the transpose of a vector — v T is meaningless! If { v} 
are the components of a vector collected into a 3 x 1 matrix, then {v} T also represents 
the same vector even though the matrix { v } T happens to be 1 x 3 . 



By this, we mean that you can point your index and middle finger of your right hand in the direc- 
tion of the first and second base vectors, respectively, and your right thumb will then point in the 
direction of the third base vector. 
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Summation convention — details 

The expression in Eq. (4.1) is written more compactly by using Einstein's summation con- 
vention as 

v = v i e i (4.6) 

The summation convention is defined such that any index (in this case i) that is repeated 
exactly twice in a term is understood to be summed from 1 to 3. The summation ranges up 
to 3 because ordinary engineering vectors are always referenced to 3D physical space. 

Later on, we will define quantities (like matrix components A tj ) that have more than 
one index. Then, for example, the expression A^v.-, for which the index /' is repeated, 
would mean the same thing as 

3 

I Vy < 4 - 7 > 

In this expression, note that the index i occurs exactly once and is not repeated. Therefore 
the above expression is actually three expressions, corresponding to the index i taking the 
values from 1 to 3. For rectangular Cartesian components, the summation convention has 
two fundamental rules (extra rules that apply for irregular bases can be found in Ref [6] 
and some less-common special-situation rules are discussed later): 

1 . An index that occurs exactly twice in a term is called a dummy index, and it is 
understood to be summed from 1 to 3, with the implied summation symbol applied 
only to the term in which the repeated dummy index appears. 

2. An index that occurs exactly once in a term is called a free index, and it must also 
appear exactly once in every other term. 

The following expressions violate the summation convention: 

a ■ + b: (violates rule 2) 

a i A i -b i (violates rule 1) (4.8) 

The following expressions all satisfy the summation convention: 

a i b i (4.9a) 

b k A ik +a i + w jk U pkqi T jp v q (4.9b) 

a,b: (4.9c) 

1 J 

a i A ij b k (4.9d) 

The number of free indices indicates the number of expressions contained implicitly in a 
single indicial expression. The first expression above has no free indices, so it corresponds 
to a th -order tensor {i.e., a scalar). The second expression has one free index, so it corre- 
sponds to a 1 st -order tensor {i.e., a vector). The next expression has two free indices, so it 
corresponds to a 2 nd -order tensor. The last expression also has two free indices, so it also 
corresponds to a 2 nd -order tensor. We will precisely define what is meant by the term 
"tensor" later; for now, we are merely clarifying notation and terminology. Incidentally, 
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whenever the term "tensor" is used, it usually refers to a second-order tensor. Many 
authors alternatively use the word "rank" or "valence" instead of "order." Hence, a tensor 
of rank 2 is the same thing as what we will call a tensor of order 2. We prefer the term 
order to avoid confusion with the meaning of rank from matrix analysis. 

Incidentally, note that Eq. (4.9b) uses £ as a dummy sum index in both the first and 
last terms. This is perfectly legitimate. The rule demanding that a dummy index must 
appear exactly twice applies to each individual term. Written out in conventional form 
using summation symbols, Eq. (4.9b) is 

3 3 3 3 3 

S (M*) + «,+ ZZZZ fykVpwW (4.io) 

k=\ j=\k=\p=\q = \ 

where the free index i ranges from 1 to 3. 

Of course, summation is commutative (you can sum over i and then/", or vice-versa, with- 
out changing the final result). Said differently, the summation signs can be applied in any 
order. For example, the above equation could be written instead as 

3 3 3 3 3 

S(M«) + «/ + ZZZ Lty^Vff) (4 - 11) 

k=\ q = \k=\p=lj=\ 

Moving the summation symbols from the jkpq order to this qkpj order has no impact on 
the result. 

Don't forget what repeated indices really mean. Newcomers to tensor analy- 
sis sometimes forget that the summation rules are really just a notational convenience. 
Sometimes it's wise to go back to conventional notation to simplify an indicial expression. 
Recall, for example, the definition of the Kronecker delta: 

\ 1 if i=J 

3 [0 if i *j 

Now consider the indicial expression 

s = 8 kk (4.13) 

There are no free indices, so the result must be a scalar. New students almost always get 
burned by using Eq. (4.12) to say that 8 kk must be equal to 1. However, this conclusion is 
wrong. The index k is repeated, so it must be summed. In other words, Eq. (4.13) really 
says 

3 

s = £ 5 M-= 5ll+822 + 8 3 3 =1 + 1 + 1=3 (4.14) 

k= 1 
Recalling the true meaning of the indicial notation is also essential for simplifying other 
expressions where 5 ■■ appears. Consider, for example, 
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AkmSmj ( 4 - 15 ) 

It is wise to mentally realize that this is really 

3 

X A km Kj (4-16) 

m = 1 

Using the definition of the Kronecker delta, note that 

A 8 =l A ^ lfm=j 
km mj 1 if m *j 

The index "m" is not intended to be summed in this particular equation (4.17) 



Consequently, only one of the three terms (A kl 8 lf , A k2 8 2 ,-, or A k3 8 3 -) in Eq. (4.16) will 
be nonzero (the one where m=j). Therefore, 

A km Kj = A kj (4-18) 

This result is just one example of how a Kronecker delta may be removed from an expres- 
sion whenever one of its indices is a dummy sum index. See page 64 for further examples. 

Further special-situation summation rules. Here are two additional rules to go 
with the two main rules given on page 57.: 

3. When a repeated subscript appears in the divisor of a fraction, it is understood to be 
implicitly summed within that divisor (i.e., the summation sign applies to that divisor, 
not to the whole expression). Free indices do not normally appear in divisors. It is 
permissible for the same repeated index symbol to appear separately in the numerator 
and divisor of an expression. For example, 



X A im W m 

AimWm means ^ (4 .1 9) 



w w 

m m 



W W 
mm 



z 

m — 1 

4. Exponent and inverse operations take higher precedence than summation rules. For 
example, Ay- 1 means the ij component of A' 1 , not X/A-. Similarly, A kk means 

tr(4 _1 ), not 1/tr^ . Whenever there is potential for confusion, it's advisable to show 
parentheses or to use words to clarify the intended meaning. 



* It's important to inform your readers when you wish to temporarily suspend the summation con- 
ventions as we have done here. Some writers indicate that they do not wish for an index to be 
summed by marking it with an overbar, as in A km b mi , or by putting the index in parentheses, as in 
A k(mft(m)i or by typesetting non-summed indices with capital letters, as in A kM b M , . 
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Indicial notation in derivatives. The summation convention also applies to deriva- 
tives. For example 

P (4.20, 

dZ i 

means the same thing as 

3 

dy-, 

Yu&r (4 - 21) 

i= 1 

Even though derivatives are denoted using a structure that looks like division, note that the 
indicial notation conventions for derivatives are different from those for ratios. In particu- 
lar, repeated subscripts in derivatives require the summation sign to go outside the entire 
expression, not just around the "divisor-like" part. 

BEWARE: avoid implicit sums as independent variables. When you 

employ the summation convention in derivatives, you should be extra careful to be clear 
about what the independent variable is. Consider for example 

w = b ll + b 22 + b 33 (4.22) 

What would the expression dw/db kk mean? There are two possible answers: 

dw dw 



db kk d ( b n + b 22 + b 33) 

or 



1 (4.23) 



d_yv_ = d_yv_ + d_M_ + dyv_ = 1 + 1 + 1 = 3 (424) 

db kk db U ^22 db 2>2> 

The two answers are not the same, so we need a. precedence rule. Our experience in read- 
ing the literature is that most authors intend for the expression dw/db kk to be interpreted 
as Eq. (4.24). Thus, the precedence rule is to always apply summations after taking deriv- 
atives. In other words, imagine that w is a function of nine &■■ components. After finding 
all nine dw/db^ derivatives, then dw/db kk is obtained by summing the three derivatives 
corresponding to i = j . To minimize confusion, we recommend that you write 

\i kk , where \i tj = ^- (4.25) 

If you really want a derivative to be interpreted according to Eq. (4.23), then you 
should write the expression more carefully as 



dw 
ds 



— , where s = b kk (4.26) 
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Reading index STRUCTURE, not index SYMBOLS 

This section tries to give a little insight to new students about how to read indicial for- 
mulas to maximize understanding and to avoid a queasy "alphabet soup" feeling when 
viewing expressions with lots of indices. 

The actual symbols selected to be free and dummy indices are entirely up to you, so 
long as your choices do not violate the summation rules. Beginning students often fail to 
read indicial formulas in the most instructive manner. Experienced professionals know to 
instead look at the structure of where the free and dummy indices appear. For example, to 
memorize some strange formula like 

da jk da ki da u 

r ^'^ + ^-^ (427) 

i j k 

you would be wise to ignore the actual symbols used for the indices. Instead, you should 
work to deduce the overall structure of the index placement. For example, if you want to 
write down the formula for Y- im , then you could always painstakingly convert Eq. (4.27) 
by replacing in all occurrences of i by /' , /' by i , and k by m . However, doing it that way 
is error prone (especially since you cannot do it step-by-step because you would violate 
the sum rules by having four/'s in the expression after step 1 of replacing i by /). People 
who really understand indicial notation would construct the formula for Y- im by spending 
a little time "smelling" the structure of the Eq. (4.27). If you look carefully at that defining 
equation, you will note that the "denominators" in the three terms on the right hand side 
have the same indices as those on the left hand side — and they also appear in the same 
order. Thus, your first step to constructing the expression for Y- im would be to write a par- 
tial "skeleton" formula as 

da 99 3a 99 3a 99 
Y- = -J1 + —H H, (4.28) 

"- dxj d Xi dx n ; 

where the "??" stands for indices not yet inserted. Again looking at the structure of Eq. 
(4.27) you would note that the subscripts on each a ?? are simply the "other two" indices 
not already in the "denominator." Furthermore, those subscripts are placed in an order that 
is a positive permutation of the free indices moving clockwise from the index already 
placed in the denominator. Specifically, the positive permutations of Jim are: Jim , imj , 
and mji . Because the first term in Eq. (4.28) has x in the "denominator," you know that 
the "other two" indices for the first term must be "im ". Similarly, the second term has x t 
in the denominator, so the other two indices must be mj (not jm because you need to 
select the same ordering as the positive permutation), etc. Thus, the final expression is 

Y = d_a 1E + d_a 3l _da I1 
Jim dxj dx t dx m 

In continuum mechanics, another common index structure is of the following form 

U ijkl = T m + W m (4.30) 
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To "smell" the structure of the index placement, you might find it useful to mentally 
replace the indices with numbers representing the order in which you should write them 
on the paper: 

^1234 = ^1324+^1423 (4-31) 

Thus, for example, if you want to write the formula for U im , then you should again start 
with a partially completed skeleton in which you place only the first two indices: 

U pq7 i = T plql + W plql (4.32) 

Then you fill out the remaining two indices im by placing them in that order on the first 
term and in the reverse order in the second term to obtain 

U ■ = T ■ +W (4.33) 

pqim piqm pmqi v ' 

Aesthetic (courteous) indexing 

Once you have derived a final result, it is often helpful to your readers if you change 
your choice of index symbols so that the free indices are ordered alphabetically on the left 
hand side of the equation. For example, if your final result is something weird like 

U skm = A si B mik> ( 4 - 34 ) 

then re-writing it in the equivalent form, 

U ijk = A in B knJ, (4-35) 

is often appreciated by (certain) readers. 

Suspending the summation convention 

An equation that violates the summation convention is usually a mistake, often indicating 
a typographical error or perhaps an error in which a dummy index was not changed to a 
different symbol prior to a substitution. Occasionally, however, one produces a legitimate 
equation that violates the summation convention, in which case, a temporary suspension 
of the summation convention must be indicated. We have already encountered one 
instance of needing to suspend the convention in our Eq. (4.17). 

The summation conventions do not allow an index to appear three or more times in a 
term. Thus, for example, the expression 

KP\(P\ * €) + X 2P 2 ^2 m 9) + ^3^3(^3 • «) (4- 36 ) 

would have to be written in traditional form by explicitly showing the summation sign: 

3 

Z *•*&<?* • *> (4 - 37) 
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The summation symbol cannot be removed because the summation index k appears three 
times. Here we had a legitimate expression in which an index occurred three times and a 
summation was desired. Below we consider the case when an index appears exactly twice 
and a summation is not desired. 

Sometimes a legitimate indicial expression cannot be written in a manner that satisfies 
the summation convention. In such a situation, the summation convention must be tempo- 
rarily suspended. For example, the z' th eigenvector {/?}• corresponding to the z' th eigen- 
value X t of a matrix [A] is defined such that 

[^]{^}/ = ^iiP}i (no sum on i). (4.38) 

The phrase "no sum on i " tells the reader that the author wishes the index i to be inter- 
preted as a free index even though it appears exactly twice on the right-hand side. 

In tensor analysis, exceptions to the summation convention are rare, so it is a very con- 
venient notational tool, especially when an expression contains numerous implied summa- 
tions, as was the case in Eq. (3.105). 

Combining indicial equations 

The following equations all satisfy the summation rules: 
<*i = AyVj d {a} = [A]{v} 

b t = ByWj O {b} = [B]{w} 

s = a i b i O s = {a} T {b} (4.39) 

The expressions on the right show the equivalent matrix expression for the operations. 
Note, in the last equation, that a transpose of { a } is required in the matrix equation. There 
is no need for a transpose on a t in the indicial expression — aj is meaningless. 

In the first two equations, the dummy summation index is / and the free index is i ; 
hence, those equations actually represent three separate equations for each value of the 
free index "z". In the last expression, the dummy summation index is i, and there are no 
free indices (indicating that the equation is just a single equation for a single scalar). 

It might be tempting to directly substitute the first two expressions in Eq. (4.39) into 
the third equation to obtain s = A-v-B-w- . However, this combined equation violates the 
summation convention because there are now four occurrences of the index /" on the right- 
hand-side. To properly combine the equations in (4.39), the dummy index /' must be 
changed to something else in one of the equations before combining the equations. The 
symbol used in place of / is arbitrary, except that it must not be i because i is already 
being used as a free index. Replacing / by k in the first of Eq. (4.39) gives a- = A ik v k , 
allowing the equations to be combined to give 

s = A ik v k B ij w j « s = {v} T [A] T [B]{w} (4.40) 

which does not violate the summation convention. Written out in traditional form, this 
equation may be written 
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S= I I Z A ik^ijWj (4.41) 

i = 1 £ = ly" = 1 

In the above analysis, we showed the equivalent matrix expressions in the right-hand col- 
umn. The above analysis could have been done entirely using matrix manipulations, but 
the skill of changing index symbols becomes indispensable when working with operations 
that have no straightforward matrix analogs. 

Index-changing properties of the Kronecker delta 

The indicial form of Eq. (3.22) may be written 

o, y v y . = v . ( 4.42) 

Note that the Kronecker delta 8 ■■ acts in a way that appears to have "changed" the dummy 
summation index / on v, to become an i on v, with the 8- removed. This "Kronecker 
removal" property holds because, in the summation over /' , only one term is nonzero (the 
one where i=j). 

This index-changing property holds in general. For example, the expression A tj v k b- 
can be simplified by noting that the subscript i on 8 ■ is a dummy summation subscript. 
Therefore, 8 ■ may be removed if the other occurrence of i is changed to a p . The simpli- 
fied expression is therefore A -v k . Conversely, given an expression A -v k for which you 
would prefer that the first index on A to be "i " instead of "p ", you can use a "Kronecker 
insertion rule" to replace the expression with A i -v k 8 i . These sorts of manipulations are 
routine, and this section covers in detail some "gotcha" precautions you must take to 
ensure that you don't violate the sum rules when changing indices. 

We have already used the Kronecker-removal index-changing property when we sim- 
plified Eq. (3.86). The Kronecker-removal rule applies in more complicated expressions 
involving multiple Kronecker deltas. Consider, for example, the expression 
T qms ^pk v q^krrfiid- Here me subscript k appears exactly twice, so it is a dummy summa- 
tion index, and the 8 , may be removed from the expression if the other occurrence of k 
is changed to a p . This gives T v 8 8 id . Now note that the index m is a dummy sum 
index, so 8 may be removed if the other occurrence of m is changed to a p to give 
T v 8 jd . The 8 jd in this final expression may not be removed because both i and d are 
free indices, not summation indices. 
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Now consider the expression 8 mk A km . Noting that m is a summation index, this may 
be simplified by removing the Kronecker delta 8 mk if the other occurrence of m is 
replaced by k to give A kk , which means A n + A 22 + A 33 and which is therefore equiva- 
lent to the trace operation of Eq. (3.51). 



Kronecker Removal Rule 



If one index on a Kronecker Delta is a dummy sum index (i.e., that index 
appears in two places), then the Kronecker delta may be removed if the 
other instance of the summed index is replaced by the second index on 
the Kronecker delta. This second index may be free or summed — it 
doesn't matter. 



(4.43) 



This Kronecker delta has the index 
"r" repeated. You can remove the 
Kronecker delta if you change the 
second "r" to an "I" 



This one has no 
repeated indices, 
so it must stay 



8 -U 5 v. = U ■ 8 v. 

ri ars pq i ais pq i 

§.[/ 8 v. = U 5 v 

ri ars pq i ars pq r 



ANOTHER VIEWPOINT 

This Kronecker delta has the index 
"I" repeated. You can remove the 
Kronecker delta if you change the 
second "I" to an "r" 



SAME RESULT WITH 
BOTH VIEWPOINTS 

(either way, the index on 
v is getting summed with 
the middle index on U) 



Above, we described how to simplify an expression by removing a Kronecker delta in 
which at least one index is summed. Specifically, Eq. (4.43) provided a way for you to 
remove the Kronecker delta from the expression. Frequently, however, you will want to 
use the index changing property in its converse by reinserting a Kronecker delta. This pro- 
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cess is more tricky because you must first verify that the indices that you hope to use on 
the inserted Kronecker delta aren't already being used elsewhere in the equation or expres- 
sion. If they are, you must be extra careful to ensure that your manipulations won't result 
in violation of the summation conventions. Consider, for example, an expression 
s n = & hnsAsi + ^nm v m • This expression is linear with respect to [A], so we know that 
there must exist coefficients C ijk such that s- = C ijk A jk . How do we go about finding 
these coefficients? By taking enough time to learn the index structure, you can probably 
slowly figure out that the final answer must be C ik = B kij + v k 8-- , but is there a step-by- 
step procedure that you can fall back on "slow-brain" days when a random walk through 
index changes just isn't producing what you seek? Such a methodical or algorithmic pro- 
cess would also be useful if you ever want to write a symbolic math program to do the 
index manipulations for you. 

The first step in reformulating an equation is to look at the structure of the target equa- 
tion, and compare that with the starting equation. If the target equation uses a different set 
or free indices, then your first order of business will be to re-cast the starting equation to 
use those free indices. In our example, we want to re-cast the equation 
s„ = B-A-+A„v„ into the new "target" form s,- = C i;t A ;t . The free index in our tar- 
get equation is "i ", but the free index in the starting equation is "n ". WARNING: before 
simply changing "n" to "i", you must first change all other occurrences of "i" in the 
starting equation to any other unused letter of the alphabet. Changing the "i " to, say, "p ", 
we get s n = B A + A nm v m . Now that "i" is nowhere to be seen, we may change the 
free index "n" to the desired symbol "i", giving s t = B is A + A im v m . When making 
these sorts of changes, remind yourself that a free index symbol will occur exactly once in 
every term, so don't forget to make the change in every term. Now that the free indices in 
our starting equation are the same as the free indices in the target equation, the new goal is 
to make adjustments in each individual term: 

Given (as an illustrative example) s t = B -A + A jm v m , (4.44a) 

determine coefficients C^ k such that s t = C ijk A jk (4.44b) 



* from the Representation Theorem, covered later in Eq. 9.7. 
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Note from Eq. (4.44b) that the desired indices on [A] are "jk". However, the first term in 
Eq. (4.44a) has indices "sp" and the last term has indices "im". By using the following 
flow chart individually on each term in Eq. (4.44a), you will be able to make the necessary 
index change adjustments. 



Given: a multi-index expression (i.e., a term in an equation) with an 
index a that you wish to instead be a different symbol p, ... 



STEP1 



Is (3 already in use anywhere 
else in the expression? 



yes 



STEP 1.1 



Change all occurrences of 

(3 to some other unused 

letter of the alphabet. 



no 



STEP 2 



STEP 2.1 




STEP 2.2 



Change a to p and multiply 
the expression by 8 a o . 



Change all (both) occurrences 
of a to p . 



STEP 3 



DOUBLE CHECK! ! ! Now that a has been changed to P , equate the original 
expression to the newly revised version and verify satisfaction of sum rules. 



You should apply this flow chart sequentially for each index that needs changing, mak- 
ing sure to always follow the steps using the latest revisions of the expressions. 
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Let's apply this flow chart to the first term on the right hand side of Eq. (4.44a), which 
is B -A . Comparing with Eq. (4.44b), we desire the index "s" to instead be "j" (we 
also want "p " to instead be "k", but the footnote of the flow chart instructs us to deal with 
only one index at a time, so let's first worry getting that "s" changed to a "j"). Using the 
flow chart, 

STEP 1 : Is "j" already in use anywhere else in the expression B-A ? No. 
STEP 2: Is "s" a free index? No, it appears twice, so it is a dummy sum index. 
STEP 2.2: Change both occurrences of "s " to "j" to obtain B-A- 
STEP 3: Equate the starting expression (in step 1) to the final expression in step 2.2: 
B„,rAr„ = B-A ■ . Are there any sum rule violations? No. Both sides have the same 

pis sp pij jp 

free index ( "i ") and all repeated indices appear exactly twice in their terms. 

Now that we have completed one revision, let's work on the second subscript on [A] . 
Again comparing with Eq. (4.44b) with our latest revision B-A- , we see that we want 
that index "p" to instead be "k". The path on the flow chart is similar to what was done 
above and the result is B k -A- k . This takes care of the first term in Eq. (4.44a). Now let's 
work on the second term, A im v m . Comparing with Eq. (4.44b), we want the index "i" to 
instead be "j". Following the flow chart, here are the steps: 

STEP 1: Is "j" already in use anywhere else in the expression A jm v m ? No. 

STEP 2: Is "i" a free index? YES, because it appears exactly once. 

STEP 2.1: Change "i" to "j" and multiply by S-- to obtain ^ /m v m 8-- 

STEP 3: Equate the starting expression (in step 1) to the final expression in step 2.1: 

^im v m = ^jm v m^ij • ^ re mere an Y sum ru l e violations? No. Both sides have the same 

free index ( "i ") and all repeated indices appear exactly twice in their terms. 

Working with the latest revision, A-v m 8--, again comparing with Eq. (4.44b) shows that 
we want the index "m " to instead be "k". Following the flowchart again lets us revise the 
expression to read A- k v k 8j- . Recalling our revised version of the first term, we now have 
our final revision of Eq. (4.44): 

s i = B kij A jk + A jk v ^ij (4-45) 

In this form, we can now compare with Eq. (4.44b) to assert that the coefficients we seek 
must be given by 

Cijk = B kij + V^ (4.46) 



Note that step 2.1 of our flow chart used the following rule: 
Kronecker Insertion Rule (for FREE indices only) 

If an expression has a FREE index a that you would like to instead be a different sym- 
bol P , then first change any existing dummy sum occurrences of (3 to any other 
unused letter. You may then change u to (i if you multiply the expression by <S,, . 

' (4.47) 
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Note that this rule (which is the converse of Eq. 4.43) is typically applied only to expres- 
sions (i.e., individual terms in an equation), and it can be applied only if occurrences of the 
desired index symbol are already present only as dummy sum indices, not as free indices. 
Note that application of this rule changes the index on a variable, without changing the 
free index. Specifically, after changing a to p and then multiplying by 8 a o , the index P 
will exist twice, so it is a dummy sum index and a is still the free index. After application 
of this rule, a will still be a free index, but it will now be a subscript on 8 instead of on 
the original variable. Because the symbol a will still be the free index symbol after appli- 
cation of this rule, you will not generally apply this rule to equations. In equations, if you 
really want to change the letter of the alphabet used for a free index, you will need to make 
the change in every single term of the equation, making sure that the new symbol was not 
already in use prior to the change (if it was, remember to first change the other occur- 
rences of the desired new symbol to any other letter of the alphabet). 



Summing the Kronecker delta itself 

Consider the expression 8 jk 8 jk . The index i is a dummy sum index on the first 8 jk , so 
that 8-£ (not the other one) may be removed if the second occurrence of i is changed to a 
k. The second occurrence of the k happens be on the second 8 ik . Thus 8 jk 8 ik may be 
simplified to become 8 kk . Recalling that 8 • equals 1 if i=j , one might be tempted to 
write 8 kk = 1 , which would be wrong. The index k is still a summation index, and there- 
fore 

hk= Sn +5 22 + 5 33 =1 + 1 + 1=3 (4.48) 

Viewed differently, this says that the trace of the 3x3 identity matrix is equal to 3. 

Our (unconventional) "under-tilde" notation 

Conventional publishing practice typesets scalars in italic while vectors and tensors 
are set in bold. As a teaching aid to add clarity to our discussion, we extend this practice 
by explicitly indicating the order of vectors and tensors by the number of under-tildes. 
Thus, for example, s denotes a scalar, v denotes a vector, T denotes a second-order ten- 
sor (to be defined later), g denotes a third-order tensor, and so on. 

Tensor invariant operations 

Unless otherwise indicated, all vector and tensor components cited in this book are ref- 
erenced to an orthonormal basis, which could be — but is not limited to — the laboratory 
basis. Lab components can be transformed to any other orthonormal basis by using the 

techniques covered on page , where it is shown, for example, that components v ■ of a 

vector v with respect to the lab basis {e v e 2 ,e 3 } are related to the components v. of the 
same vector with respect to a different orthonormal basis {e v e 2 ,e 3 } according to 
v,- = Q,:V. where Q.. = e • e . The base vectors themselves are related by e = Q, ; e.. 
Importantly, it is shown on page that the [Q] matrix is orthogonal (i.e., Q ki Q kj = 8- ■). 
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Though probably not immediately obvious, this orthogonality property ensures that the 
component formulas for the vast majority of operations described in this book take pre- 
cisely the same structural form in any orthonormal basis. For example, the vector dot 
product is defined for the lab basis as a k b k , and if you apply transformation formulas to 
substitute a k = Q ki a t and b k = g, a, then orthogonality of the [Q] matrix shows that 
the dot product can be computed by a k b k , which is precisely of the same form as the for- 
mula that uses lab components. This sort of result is typical of tensor and vector opera- 
tions. The linear transformation formula for y = F * x is computed by y t = F t -x- with 
respect to the lab basis and y t = F t :%- with respect to a different "hat" basis (it is shown 

on page that the lab and "hat" components of the tensor F are related by 

Fit = Qi m Qj n F mn )- Note that the component formulas are identical in structure. The 
components of the output vector are different in the two systems (i.e., y t ^y t ). However, 
the output vector itself is computed by multiplying the components by the base vectors: 
y = y t e. or y = y t e.. Even though the components are different, this product of compo- 
nents times base vectors will give the same final result for y . In fact, any operation whose 
component formula has the same structure in any orthonormal basis is referred to a ten- 
sor invariant operation. After multiplying components times base vectors, you will 
obtain the same tensor (or vector) regardless of which basis you used in your component 
calculations. Knowing that an operation is invariant is extremely helpful because it gives 
you licence to perform the operation in any convenient orthonormal basis, and you can 
rest assured that the resulting tensor (or vector) will be the same as if you had instead per- 
formed your component calculations in a different basis. 
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"Blessed are those who expect nothing, 

for they shall not be disappointed. " 
— Carl Sandburg 



5. Simple vector operations and properties 



Dot product between two vectors 

GOAL: Define, cite properties, show application to find angle between two vectors, show 
application to decide if a vector is zero. 



Using the summation convention, the dot product between two vectors v and w is* 



v • w = v k w k 
Written out in full, 

V • W = VjWj + V 2 W 2 + V3W3 

In matrix notation, this can be written 



(v • w) 



[- — 


r 


— -1 


v l 




Wj 


V 2 




w 2 


V l 




w 3 _ 



{V}T{W} 



v l v 2 V 3 



M', 



W~ 



Wn 



<v>{w} 



The magnitude of a vector v is given by 

v = IIhII = + a/ v ? + v 2 + v 3 = +Vk • K 



(5.1) 



(5.2) 



(5.3) 



(5.4) 



* This document presumes that all vectors are real. If however, you wish to generalize the inner prod- 
uct between two vectors y and w that might have complex components, then the dot product 
should be revised toy*^ = v»w - v k w t , where the overbar denotes the complex conjugate. 
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Geometrically, the dot product can be written 

v • w = vw cos9„„, , (5.5) 

where v and w are the magnitudes of v and w , respectively, and 
9 VVV , is the angle between v and w . The dot product is commuta- 
tive: 

v • w = w • v (5.6) 

It also satisfies the inner product positivity rule 

v • v > if v ^ 

v«v = if and only if v = (5.7) 

This positivity property implies that the magnitude of a vector, as defined in Eq. (5.4), will 
always be real. 

Dot product between orthonormal base vectors 

If {e v e 2 , £ 3 } is an orthonormal basis, then 

%•% = &„, (5.8) 

where (recall) the symbol 8 ■ is the Kronecker delta, defined 

(5.9) 




A "quotient" rule (deciding if a vector is zero) 

GOAL: Explain that you can't define division by vectors, but there is an extended viewpoint 
that is similar. 

Suppose the product of two scalars u and v is zero. Then we all know that you may 
conclude that w=0 and/or v=0 . Furthermore, if uv = for all choices of u, then you 
may conclude that v must be zero. 

Now suppose that the dot product of two vectors u and v is zero. Then, based on the 
definition of the dot product, you may conclude that one of three possibilities exist: 
(1) u is zero, (2) v is zero, or (3) u is perpendicular to v . More importantly... 

If u • v = for all choices of u , then v = 0. (5.10) 

A vector is zero if and only if all of its components are zero. 



Keep in mind that we are considering only ordinary engineering vectors having real components. If 
complex components were allowed, the inner product would be written v • w = v k w, , where the 
overbar denotes the complex conjugate. 
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Deciding if one vector equals another vector. Not surprisingly, two vectors q 
and b are equal if and only if q - b = ■ Thus, the above tests for deciding if a vector is 
zero can be applied to tell if two vectors equal each other. Specifically, Eq. (5.10) can be 
written 

If a • « = b • u for all choices of u , then q = b . (5.11) 

Two vectors are equal if and only if corresponding components are equal. Without the pro- 
viso that Eq. (5.11) holds for all choices of u, the best you would be able to conclude is 
that q - b is perpendicular to the span of admissible choices for u . If, for example, you 
were told that q • u = b • u for all vectors u in the 2-3 plane, then you could conclude 
that q-b must point in the 1 -direction. This would not imply that either q or b each indi- 
vidually point in the 1 -direction; instead, it would imply that a 2 = b 2 and a 3 = b 3 . 

These statements seem self-evident in this simple 3D context, but become quite impor- 
tant in higher dimensions. 

Finding the i-th component of a vector 

GOAL: Show that the i component of a vector can be found by dotting that vector by the 
i base vector. 

Recall that any vector y can be expressed as 

v = Vjgj + v 2 e 2 + v 3 e 3 (5.12) 

Dotting both sides with e x gives v • e x = v x . Similarly, v • e 2 = v 2 and v • e 3 = v 3 . 
Hence, the i th component of a vector with respect to an orthonormal basis {e { , e 2 , e 3 } 
can always be found by 

v j = y • e i (5.13) 

This relationship can be derived using strictly indicial notation by noting that Eq. (5.12) is 
equivalent to 

K = v k<Lk ( 5 - 14 ) 

Dotting both sides by g-, invoking Eq. (5.8), and finally using the index-changing prop- 
erty of the Kronecker delta (Eq. 4.43) gives 

fe t = v k e k *e ( = v k 8 u = v t (5.15) 

which is equivalent to Eq. (5.13). This method for finding the component of a vector 
might seem at first glance to be trivial and of no obvious use. Suppose however, that 
{e*, e 2 , e 3 ) is a different basis. Further suppose that we do know the components of y 
with respect to the original (unstarred) basis, but we wish to determine the components of 
this vector with respect to this new (starred) basis. Then v* = y • e* . As a specific exam- 
ple, suppose that 

el = l -(3e l +4e 2 ), e* = -e\, and e* = \(-4e l +3e 2 ) (5.16) 

Suppose that we know that, with respect to the unstarred basis the vector y is given by 
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v = 2g 1 + 5g 2 (5.17) 

Then the components with respect to the unstarred basis are just Vj = 2, v 2 = 5 and 
v 3 = , whereas the components of this vector with respect to the starred basis are 

v\ = v.e; = (2e l + 5e 2 ).\(3e l+ 4e 2 ) = | + ^ = | (5.18) 

v* 2 = v.g* = (2f j + 5f 2 ) • (-g|) = (5.19) 

v 3 * = » . el = (2 ?1 + 5e 2 ) . ±(-4 ?1 + 3e 2 ) = ^ + ^ = 1 (5.20) 

The method presented in this section works only when the new (starred) basis is orthonor- 
mal; see page 88 to learn how to find the components of a vector with respect to an irregu- 
lar (non-normalized and/or non-orthogonal) basis. 

Even and odd vector functions 

GOAL: Define, show function decomposition into even plus odd parts 

If a function f(v) has the property that f(-v) = f(v) , then the function is said to be 
even, and it is independent of the vector's directional sense. For example, the operation 
v • v is even. On the other hand, if /"(— y) = -f(v) , then the function is said to be odd. 

Any function f(v) may be decomposed into its even part f(v) plus its odd part f(v) 

as 

f(v) =/(v)+y°(v) (5.21) 

where 

f(v) = |[/(v) +/(-*)] 

f(v)-|[/(y)-/(-y)] (5.22) 

Homogeneous functions 

GOAL: Define, show identities 

A function/ is said to be homogenous of degree k if it satisfies 

/(ay) = a k f(v) for all positive scalars a . (5.23) 

For example, f(x) = x 3 is homogeneous of degree 3. The function /(x) = x/|x| is 
homogeneous of degree zero. The function /(x) = 1 + x is not homogeneous of any 
degree. 

When a function is homogenous of degree k, then can be shown [ ] that 

AY) • v = kf(v) (5.24) 

where f'(y)=(df/dv i )e i . Furthermore, the function /'(y) is homogeneous of degree k—1. 
That is, 

/'(ay) = a k - l f'(v) (5.25) 
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Vector orientation and sense 

GOAL: Clarify terminology 

The term "orientation" will be used to describe a line that is parallel to a given vec- 
tor. The terms "direction" or "sense" will be used to describe the direction that a vector 
points along its orientational line. Thus, for example, the direction of -y is opposite that 
of v whereas the orientations of the two vectors are identical because they lie in parallel 
directions. 

Suppose that a function f(v) is homogeneous of degree zero. In other words, 
putting £=0 in Eq. (5.23), we are supposing that a function satisfies the property that, for 
all scalars a , /(ay) = f(v) . Then the function f(v) depends only on the vector's orienta- 
tion, not on its magnitude or sense. 

Simple scalar components 

GOAL: Find the scalar component of one vector in the direction of another. 

The vector inner (dot) product is extremely useful for extracting parts of vectors (or ten- 
sors) in particular directions. 



w 



W • V 




^ 



V • w 




(a) 



(b) 




Figure 5.1. Finding components via projections, (a) scalar component of v in the direction of w, 
(b) scalar component of w in the direction of v , and (c) the scalar components of v in the directions of 
the base vectors. 



The operation 



v • w . 



where w ■■ 



w 



\w\ 



(5.26) 



gives the (rectangular) component of y in the direction of a second vector w . Since we are 
only talking about the direction of w , the actual magnitude of w is irrelevant — that's 
why the formula depends only on the unit vector w that points in the direction of w . The 
formula of Eq. (5.26) would not change if we were to multiply w by any positive scalar 
a . The result changes sign if w is replaced by -w . 

Just as y can be projected onto w , the reverse operation of projecting w in the direc- 
tion of y gives the component of w in the direction of y . 



w • v , where v = 77=77 

v 



(5.27) 



This operation depends on the direction of y , but not its magnitude. 
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Eq. (5.13) is a special case of Eq. (5.26) in which w is e i . Thus, v- is the projection of 
v in the i th coordinate direction. 



Cross product 

GOAL: Define, show identities, show how to find the area of the parallelogram formed by 
two vectors 

The cross product between two vectors, q and b is a 
vector defined as: 

qxb = ab(smQ ab )n, (5.28) 

The unit vector it is perpendicular to both q and b , with 
a direction defined by the right hand rule when sweeping 
from q to b through the angle Q ab . Some books will tell 
you that the angle Q ab must be less than 180° , but that's 
not necessary. While it's true that the smaller angle 
between q and b is conventionally used, you can alter- 
natively sweep through the larger angle, again by the 
right-hand rule; doing that will change the sign of both 
sin9 a/) and n, making the result in Eq. (5.28) 
unchanged. 

The parallelogram in the illustration has an orientation perpendicular to qxb. The 
area of the parallelogram equals the magnitude of q x b . 

If a = qxb, then the components of u are 




Figure 5.2. Cross product 



a 2 b 3 



a 3 b 2 



a 3 b l -a l b 3 



a l b 2 



a 2 b l 



Hence, 

qxb = (a 2 b 3 - a 3 b 2 )e l + (a^b^ -a l b 3 )e 2 + (a l b 2 - arjj^e^ 
Heuristically, this equation is often written as the determinant of a matrix: 



(5.29) 



(5.30) 



ax b 



det 



Si ?2 ?3 

flj a 2 a 3 
b x b 2 b 3 



(5.31) 



Cross product between orthonormal base vectors 

GOAL: Cite important special-case of the cross product between base vectors. 

Applying the definition of the cross product reveals that the nine possible ways to cross 
the orthonormal base vectors with themselves give 
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€i x €i 


= Q 


%Z 1 /> C- ^ C- T 


C-i A cJt c-^ 


e 2 x e l 


= -€ 3 


e 2 x e 2 = 


C-n /> C-T C- 1 


?3 X €l 


= e ~2 


C^ T " *'') C 1 


€3 x €3 = 



(5.32) 
These expressions may be written compactly using the summation notation as 

(5.33) 



€,• x Sj = e ijk e k 



where e ik is the permutation symbol defined in Eq. (3.76). 

You can use Eq. (5.33) to deduce the component (indicial) expression of the cross 
product. Namely, 

axb = (a,e) x (b,e) = a,b f (e- x e.) = a,b,e..,e, (5.34) 

The last step applied Eq. (5.33). Noting that the final result is the sum over k of an expres- 
sion times e k , the k th component of the cross product operation must therefore be 



(a x b) k = ai bjE. Jk 



(5.35) 



This formula relies on our previously stated assumption that all component formulas 
in this book are referenced to an orthonormal right-handed basis. If you use an orthonor- 
mal left-handed basis, then the above formula would be (qxb) k = -a t b •£.., . Some 
authors take this situation as an implication that the permutation symbol for left-handed 
base vectors should be defined as the negative of the right-handed definition. This is mis- 
leading and wrong-headed. What's really going on is that the cross product operation can 
be most generally written in structured notation as a special third-order alternating tensor 
t, operating on the vectors « and b . [Namely, using notation to be defined later in this 
book, « x b = t,:{qb) .] The components of the alternating tensor can be proved to equal 
^iik = e ijk if me basis is orthonormal and right-handed, while t lj j k = s jk if the basis is 
orthonormal but left-handed. The <;■ ^ components have yet a different form if the basis is 
non-orthogonal or non-normalized* Note that the permutation symbol does not change 
sign for a left-handed basis — only the components of the alternating tensor £, change 
upon a change of basis. We reiterate that, although the form of the component formulas for 
«x6 depend on the nature of the basis, the final result for a x b is the same in all cases. 
In other words, qx b represents a particular and unique vector that does not depend on the 
underlying basis. Only the method that you must use to determine this unique vector varies 
depending on the choice of basis. 



* Namely, if {g v g v g,} is a linearly independent set of vectors, then £,- k = g • (g. *g k ) 
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Triple scalar product 

GOAL: Define, cite properties, show application to deciding if three vectors are linearly 
independent. 



Given three vectors, q , b , and c , the triple scalar product is defined 
[a, b,c] = (qx b) • c 
For rectangular Cartesian components, this operation can be computed by 



(5.36) 



[q, b, c] = det 



C1 1 Cl^ Ctn 

b l b 2 b 3 



c l c 2 c 3 



(5.37) 



The fully indicial form of the triple scalar product is 



[«> k, c] 



& ijk a i b j c k 



(5.38) 



The triple scalar product can be used to test whether or not three vectors are linearly inde- 
pendent: 



Three vectors, q , b , and c , (in 3D space) are lin- 
early independent if and only if [a, b, c) -A . 



(5.39) 



It can be shown that the triple scalar product has the same value if the vectors are posi- 
tively permuted and it changes sign if the vectors are negatively permuted. Specifically, 



[a, b, c] = [b, c, a] = [c, a, b] 



(5.40) 



and 



[a, b, c] = -[c, b, a] = -[b, a, c] = -[a, c, b] (5.41) 

Physically, the absolute value of [«, b, c] equals the volume of the parallelepiped formed 
by a, b, and c. The sign of [«, b, c] will be positive if the vectors form a "right- 
handed" triad, meaning that when the thumb of the right hand points in the direction of 
a and the index finger points in the direction of b then the middle finger will point 
roughly in the direction of c (i.e., if the middle finger were a vector, it would have a posi- 
tive dot product with c). If the sign of [a, b, c] is negative, then the triad is said to be 
"left-handed." 
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Triple scalar product between orthonormal RIGHT-HANDED 
base vectors 

GOAL: Cite the triple scalar product between right-handed base vectors and argue against 
redefining the permutation symbol for other types of basis triads (instead, advocate using 
different values for the permutation tensor components). 

Dotting Eq. (5.33) by e m gives 

(ex e) • e = s ,S, = s (5.42) 

V~i Xy/ ~ m ljk km ijm v*^"-l 

where s ■ - k is the permutation symbol defined in Eq. (3.76). Expressing the above result 
with the free index m replaced by k gives 

(5.43) 



6,7*= [gpS/.S*] 



The triple scalar product [e., e-, e k ] is certainly well-defined if the basis is left-handed; in 
fact, the result is [e t , e- , e k ] = -s ■ k . As mentioned earlier, this fact should not be used as 
justification for redefining the permutation symbol when using a left-handed basis. We 
recommend always defining the permutation symbol such that £i23 =+ l even if the basis 
is left-handed. 

Even though the term "tensor" has not yet been defined, it's worth mentioning here (for future refer- 
ence) that a straightforward formula exists for constructing a third-order permutation tensor in terms of any 
basis — including left-handed and even non-orthonormal. The permutation tensor components with respect 
to a non-orthonormal basis take yet a different form (covered in the more advanced Ref [6]), and the process 
of computing the triple scalar product becomes more complicated. Nonetheless, the basic concept is the 
same: the triple scalar product of three vectors equals the triple inner product of the alternating tensor into 
the "dyadic" multiplication (defined later) of the three vectors. It just happens that the components of the 
alternating tensor equal the permutation symbol when the basis is orthonormal and right-handed. It is for this 
reason that we denote the alternating tensor by a symbol ^ ... that differs from its right-handed orthonormal 
components £ ■ ■/ . A similar notational choice is also made when we denote the identity tensor, I, by a sym- 
bol that differs from its right-handed orthonormal components (the Kronecker delta 8 • • ). 
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"I am always ready to learn, although 
I do not always like to be taught" 

— Winston Churchill 
\ / 

6. Projections 

Mathematically, a projection operation is any function P(x) for which 

P(P(x)) = P(x) (6.1) 

In other words, once the function P has been applied, then applying it a second time will 
not change the result. Below, we will discuss rank-1 projections that will return the part of 
a vector x in the direction of some other vector. This is a projection because, if the first 
vector is already parallel to the second vector, the projection operation will simply return 
the first vector unchanged. We will also discuss rank-2 projections that return the part of a 
vector contained in a specified plane. This type of projection is like a formula for finding 
the shadow of a vector on the plane. If the vector is already in the plane, it's shadow is 
itself, making this operation a projection. As discussed below, projections can be linear or 
nonlinear. 

Orthogonal (perpendicular) linear projections 

GOAL: Show how to find the part of a vector in the direction of another vector (and clarify 
distinction between this and finding the scalar component in the direction of a vector). 

Equation (5.26) shows how to find the scalar component of v in the direction of w . If 
we were to multiply the result by w , then we would obtain a vector that is in the direction 
of if or, if v • w < , a vector that is in the opposite direction of w . This operation, in 
which we multiply the component of v in the direction of w by w itself is called the 
orthogonal vector projection of v onto w , and we will denote this vector by v Dw (which 
may be read as "the part of v in the direction of w "). The mathematical definition is 

v Dw = (v • w)w where w = 77^77 (6.2) 

~ ~ ~ ll^ll 

For some applications, it is prudent to recognize that the projection operation involves 
two vectors, v and w , so it is sometimes advisable to instead define a binary* operator D 
such that D(v, w) denotes the part of v in the direction of w . In terms of this alternative 
notation, Eq. (6.2) would read 



The term binary is merely a fancy way of saying that the operator has two arguments. 
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( V * w\ 
D(v,w) = - — - \w (6.3) 

~ ~ ^*$ • *r ~ 

Clearly, 

D(v, w)*D(w, v) (6.4) 

The part of the vector v that is "left over" — i.e., v— v Dw — is the part of the vector v 
that is perpendicular to w , which we will denote by v Pw or by P(v, w) . It is defined by 

yPw = v-(v*w)w (6.5) 

or 

( v * w\ 
P(v, W) = V- -W (6.6) 

~ ~ ~ ^W • W ~ 

Note that v Pw lies in the plane perpendicular to w . Also note that 

P(v, w)+D(v, w) = v (6.7) 

This equation shows more clearly that the operators P and D decompose the vector v into 
two parts, one parallel to w and the remainder perpendicular to w . 

To make a sketch of v Dw , simply draw a line parallel to w that passes through the tail 
of v . Then draw a line perpendicular to w (or, for 3D problems, draw & plane perpendicu- 
lar to w) that passes through the tip of the vector v . These two lines (or, for 3D problems, 
the line and the plane) will intersect at a single point, which we will call A . Then v Dw is 
the vector extending from the tail of v to A and v Pw is the vector extending from A to the 
tip of v. See Fig. 6.1. 
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Figure 6.1. Vector decomposition, (a) decomposition of v in directions parallel and per- 
pendicular to w , (b) decomposition of w into parts parallel and perpendicular to v , and (c) the 
projection of w onto the unit base vectors. 

As mentioned earlier, D(v, w) ^D(w, v) . Nonetheless. The vector w may be simi- 
larly decomposed into parts that are in parallel and perpendicular to v by the formulas 
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w Dv = D(w, v) = (w • v)v and 
w Pv = P{w,v) = w-{\yv)v 

v 

where v = rprr (6.8) 

||v|| 

Figure 6.1 clearly shows that this decomposition of w results in completely different vec- 
tors as the decomposition of v . 

The last sketch in Fig. 6.1 shows the decomposition of a vector iv into parts that are 
aligned with the base vectors. In particular, note that we labeled the vertical part of the 
vector as w 2 because, in three dimensions w Dei ■*■ w Pei . Suppose, for example, that the 
vector is w = 6e x + 3e 2 + 7e 3 . Then 

w De2 = 3e 2 (6.9) 

whereas 

w Pei = 3^2 + 7^3- (6.10) 



Rank-1 orthogonal projections 

GOAL: Explain that finding the part of a vector in the direction of another vector is a 
projection operation, and explain why this projection has "rank 1". 

The notation q Db symbolizes the orthogonal (perpendicular) projection of a vector q 
in the direction of a second vector b . The symbol q Db may be referred to as "the part of q 
in the direction of b ." Since this operation involves two vectors, you might alternatively 
prefer to denote it in a more standard way by D(q, b) . The result is always going to be a 
vector parallel to b . The adjective "orthogonal" or "perpendicular" is used to indicate that 
each point on the vector q maps to the closest point on a line parallel to b ; therefore, the 
projection direction is a family of lines that are perpendicular to b . The set of all vectors 
parallel to b forms a one-dimensional subspace because any member of the set may be 
written in the form ab , which involves only one arbitrary scalar a. 

If n is a unit vector, then any vector x can be projected into a part that is parallel to n 
and simultaneously perpendicular to the plane whose normal is n 



p = n(n • x) 



(6.11) 



In other words, p is just x Dn . This projection has rank 1 because the target space is the 
one-dimensional line parallel to p . If one were to compute the average of x over all rota- 
tions of x about n , then the result would be the vector p . 
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Plane perpendicular to « 




(b)y 



Plane perpendicular to « 



Figure 6.2. (a) Rank-1 orthogonal projection, and (b) Rank-2 orthogonal projection. 
The dashed lines show the projection direction. For the Rank-1 orthogonal projection, the dashed lines 
point from a location on x to a target line that is parallel to the unit vector n (the target line can be 
translated so that it passes through any point in the plane without changing the result for the projection 
vector p . For the Rank-2 projection, the dashed lines point from a location on x toward the shortest dis- 
tance to" the plane if the plane is positioned at the tail of the vector x . The projections are orthogonal be- 
cause the path from the vector x to the target line or plane is the shortest distance. 



Rank-2 orthogonal projections 

GOAL: Show how to find the orthogonal (nearest) projection of a vector onto the plane 
perpendicular to another vector. 

As sketched in Fig. 6.2, any vector x can be projected onto a plane with unit normal n 
by using the formula 



x-n(n • x) 



(6.12) 



In other words, q is just x Pn . This transformation is called an orthogonal projection 
because the projected vector q represents the "shadow" cast by x onto the plane perpen- 
dicular to n when the light rays (formally called level lines) are coaxial with n . (Note: the 
term "coaxial" here means aligned, but not necessarily of the same sense.) The projection 
is second-rank because the target space to which the vector is being projected is two 
dimensional (a plane). 



Basis interpretation of orthogonal projections 

GOAL: Emphasize that the rank-1 and rank-2 projections effectively extract "pieces" of the 
starting vector that break it down into smaller parts relative to a locally aligned basis. 

The vector n can have any orientation. In order to better interpret equations like (6.11) 
and (6.12), it is often useful to set up a basis that has, say, its e 3 direction aligned with n . 
If we align e 3 with n, then the plane in Fig. 6.2, would be the 1-2 plane. Substituting 
n=e 3 into Eqs. (6.11) and (6.12) and applying Eq. (5.13) gives 



p = e 3 (e 3 • x) 



X 3?3 



x 3 e 3 . 



Xjgj + x 2 e 2 



(6.13) 
(6.14) 
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Thus, the projected vector p is the part of x that is in the 3-direction, and q is the part of 
x that is in the 1-2 plane. In many engineering applications, there exist multiple planes to 
which vectors are projected, so it is not always possible to merely set up a single basis that 
is lined up with all of the planes of interest — that's why our direct notation equations 
(6.11) and (6.12) are more convenient. Furthermore, the vector x and the plane's normal 
n might be changing in time. In this case, the direct notation formula of Eq. (6.12) is most 
convenient because it allows direct computation of rates. 

The concept of a projection will now be generalized to permit us to find the "late after- 
noon shadow" of the vector x when the "light rays" are oblique to the plane. 




Rank-2 oblique linear projection 

GOAL: Explain oblique (not nearest point) projections onto a plane. 

Figure 6.2(b) showed how to find the shadow 
of a vector at "high noon," when the sun was 
directly overhead so that the light rays were per- 
pendicular to the target plane. As sketched in 
Fig. 6.3, a more general kind of projection allows 
the "light rays" to intersect the plane at an oblique 
angle. Now we seek the formula for the shadow of 
x in the late afternoon, when the sun is shining 
from an angle. This kind of projection can be char- 
acterized via two vectors q and b . The target plane 
is defined to be perpendicular to b , and the light 
rays are parallel to q . The magnitudes of these vec- 
tors are inconsequential since they are only being 
used to define orientations (see page 75). 

As before, we seek an expression for the vector q that is the projection of x onto the 
plane. This time, however, we want the projection direction (the "light rays") to be aligned 
with a different vector q . Referring to Fig. 6.3, we can see that there must exist a scalar 
coefficient such that the vector x can be written as the sum of q plus some (as yet) 
unknown multiple of q : 

x = q + r\q, (6.15) 

To find the value of r\ , we impose the condition that the vector q must lie in the plane. In 
other words, b • q must be zero if we want q to be perpendicular to b . Dotting both sides 
of Eq. (6.15) by b (and setting b • q = ) gives 

b»x = + T\(b»a). (6.16) 

Solving for r\ and substituting the result into (6.15) gives the desired formula for the 
oblique projection: 



Plane perpendicular t> 



Figure 6.3. Oblique projection. 
The paths of projection (dashed lines) 
are all parallel to a , so they obliquely in- 
tersect the plane. The result for q is un- 
affected by translation of the plane. 
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q = Q(x) , where 




(6.17) 



Naturally, Eq. (6.12) is a special case of the more general Eq. (6.17), obtained by choosing 
q=b=n . In other words, the projection is orthogonal only if q is proportional to b . 



Rank-1 oblique linear projection 

GOAL: Explain oblique projections onto a second vector. 

The remaining part of x is obtained by a rank 1 
projection. Namely, p = x - q . Thus, 



p = P(x) , where 




. (6.18) 



The result of this operation will always be a vector 
that is simply a scalar multiple of q . This target 
space is one dimensional, so the projector P has 
rank 1. 




Plane perpendicular to 7 * 



Figure 6.4. Rank-1 oblique projec- 
tion. The path obliquely intersects the 
plane. 



Note that the operator P has the property that 
P(P(x)) = P(x) . Physically, this means that pro- 
jecting a vector that is already in the target space will just give you back that vector 
unchanged (your shadow has no shadow other than itself). This property is, in fact, used to 
define the term "projection." The operator Q has the similar property that 
Q(Q(x)) = Q(%) ■> so ^ is therefore a projector. 

Degenerate (trivial) Rank-0 linear projection 

GOAL: Explain that the zero operator is a degenerate projector. 
Consider a function that does nothing but return the zero vector: 

P(x) = (6.19) 

As a special case, note that 

P(0) = (6.20) 

Though somewhat silly-seeming, we can then state that 

P{x) = P(0) (6.21) 

Applying the zero operator a second time to both sides of Eq. (6.19) gives 

P(P(x)) = P(0) (6.22) 

or, using Eq. (6.21), 

P(P(x)) = P(x) (6.23) 
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Hence, Eq. (6.12) permits us to assert that the uninteresting zero operator is a projection. 
By its definition, it is also a linear operator and its range space, trivially, contains only the 
zero vector. Hence the zero operator is a rank-0 projection because its range space is zero- 
dimensional (a single point in space). 

Degenerate (trivial) Rank-3 projection in 3D space 

GOAL: Explain that the identity operator is also a projection. 
Consider the identity operator: 

P(x) = X (6.24) 

Applying this operator a second time to both sides of this equation gives 

P(P(x)) = P(x) (6.25) 

Hence, trivially, the identity operation is a projection according to the definition in 
Eq. (6.12). Since we are considering vectors in three-dimensional space, the range of the 
identity operation is 3D space, making this a rank-3 projection. 

Complementary projectors 

GOAL: define, begin introducing concepts needed for the projection theorem 

The operator P is called the complement of Q . In general, two operators P and Q are 
called complementary projectors if the following properties hold 

P(P(x)) = P(x) (6.26) 

Q(Q(X)) = Q{X) (6.27) 

Q(P(x)) = P(Q(x)) = (6.28) 

P(x) + Q{x) = x (6.29) 

The last property states that the sum of P and Q must be the identity operation (this is an 
abstract way of saying that the P and Q operators permit an additive decomposition of the 
vector x ). The rank of P plus the rank of Q must sum to equal the dimension of the 
space, which is 3 for ordinary physical vectors. 

Normalized versions of the projectors 

GOAL: Generalize the "aligned" basis description of a projector to show that the structure 
is very similar for oblique projections except that the "aligned" basis is non-orthonormal. 

The projectors Q and P in Eqs. (6.17) and (6.18) are homogeneous of degree zero 
with respect to « and/or b . (i.e., multiplying either of these vectors by any nonzero scalar 
does not affect the outcome of the operations). This property does not mean that the pro- 
jection formulas depend on only the angle between q and b . The scaling property simply 
implies that the formulas are insensitive to the magnitudes and senses of « and b — only 
their orientations matter (see page 75). 
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Because the magnitudes of q and b are arbitrary, it is convenient in certain applica- 
tions to replace them with q and b , which have the same orientations as q and b , but 
whose magnitudes satisfy 

q»b=\ (6.30) 

One possible way to construct q and b is* 

" n b 

and b = —== (6.31) 



J a • b Jq • b 

When the property of Eq. (6.30) holds, q and b are called "dual" vectors. Using the 
dual vectors, Eq. (6.17) simplifies to 



q = x- q(b • x) 



(6.32) 



The component form of Eq. (6.17) take a particularly simple form when expressed 
using a nonorthogonal basis having the covariantt base vector g = q and the contravar- 
iant base vector g 3 = b . Namely 

q = x l g x +x 2 g 2 , (6.33) 

This result is strongly analogous to Eq. (6.14), with the key difference being that the g, 
base vectors are nonorthogonal and not generally of unit length. The projector Q is a 
rank-2 projector because its range space is two dimensional. 

A vector that is pointing directly at the sun will have no shadow at all. The null 
space of the projector Q is the set of all x for which Q{x) = . Setting Q{x) = in 
Eq. (6.17) reveals that the null space of that particular projector is the set of vectors that 
are proportional to q . Thus, the null space of the projector is one-dimensional. The range 
space (i.e., the target plane) is two dimensional. Since P and Q are complementary pro- 
jectors, the null space of one is the range space of the other! Later on, projectors will be 
defined for higher-dimensional spaces and the null spaces will be more interesting. 



* This formula applies when a • b > . For a • b < , then b should be replaced by -b before apply- 
ing this formula. 
t When a basis {g , g., g, } is nonorthonormal, there naturally arises a useful companion or "dual" 

basis denoted l^ 1 ,^ 2 ,^ 3 } which is defined such that g' • g - 8- , where 8' is the Kronecker delta 
of Eq. (5.9). Thus, for example, g 1 is perpendicular to the plane formed by g 2 and g 3 . A vector 
can be expressed in terms of either basis as v = v'g . = v t g l . Subscripted quantities are called 
"covariant" and superscripted quantities are "contravariant." (A cute mnemonic is "co-go- 
below"). Non-orthonormal tensor analysis is reviewed in Refs. [7,6]. 
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Figure 6.5. Projections of two vec- 
tors along a an obliquely oriented 
line. 



Figure (6.5) shows two vectors, x and y , that fall 
on the line defined by q . More precisely, for some 
scalar p , 

x = j + pfl. (6.34) 

As seen in the sketch (or as verified by direct sub- 
stitution into Eq. (6.17)), 

Q(x)=Q(y) . (6.35) 

Conversely, if (6.35) holds, then so does (6.34). 
This property of projections is the key to validating 
radial or oblique return algorithms in the field of 
plasticity. 



Expressing a vector as a linear combination of three 
arbitrary (not necessarily orthonormal) vectors. 

GOAL: outline most straightforward process, refine notation for the process to be more 
consistent with curvilinear notation. 

Any vector x can always be expressed as a linear combination of three other vectors 
q , b , and c as long as those three vectors are linearly independent (i.e., so long as the tri- 
ple scalar product is nonzero: [q, b, c] * 0). If so, then we know there exist scalar multi- 
ples a , p , and y such that 

x = aq + fib + yc (6.36) 

The brute force simplest way to determine values of the scalar coefficients is to simply dot 
both sides of this equation by q to obtain 

x • q = a(« • «) + P(6 • a) + y(c • a) (6.37) 

We can similarly dot both sides of Eq. (6.36) by b and then separately by c to obtain two 
additional equations which, with Eq. (6.37) forms a set of three equations and three 
unknowns (the {a, P, y} coefficients). The system is solvable if and only if the original 
three vectors are linearly independent. We will now discuss this identical process using a 
slight change of notation so that it become more clear that each component actually corre- 
sponds to a rank-1 oblique projection of the vector x onto the three vectors. To simplify 
the notation, we will now denote q , b , and c by three different symbols, {g., g y g 3 } . 
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The right-hand side of Fig. 6.1 showed how an arbitrary vector x may be decomposed 
into the sum of parts that are aligned with the orthonormal {e v e 2 , e 3 } basis. However, a 
basis does not have to be orthonormal — any three linearly independent vectors 
{g., g„, g 3 } may be alternatively used as a basis. We wish to additively decompose a vec- 
tor x into parts aligned with these three non-orthonormal base vectors. Stated differently, 
we wish to discover a path from the tail to the tip of x that always travels parallel (or anti- 
parallel) to these three base vectors (See Fig. 6.6). 





Figure 6.6. Three oblique projections. The indicated plane contains g and g., while g. 
forms an oblique angle to the plane. The dual vector g 3 is proportional to g x g so it may be used 
to define the normal to the plane. 



First, in order for the three {g,,g 2 , g 3 } vectors to be linearly independent (and there- 
fore form a basis), they must have a positive triple scalar product: 



J o- ls v g r s 3 ] = (s l x g 2 )*s 3 >o 



(6.38) 



Corresponding to the {g,,g 2 ,g 3 } base vectors, there exists a unique "dual" basis 
{g\g 2 ,g 3 } such that 

g.*g J = 5^ (where 8j is an alternative symbol for the Kronecker delta). (6.39) 

In other words, g 1 must be perpendicular to g 2 and g 3 , so it must be proportional to 
(g x g ) . The constant of proportionality must be set so that g • g l = 1 . Thus, as can 
be verified by direct substitution, the dual basis must be given by 



? 1 = 7 ( f 2 x f 3) ' s 2 = j(g 3 x g ,) , g 3 = j(g x x g 2 ) 



(6.40) 



Without proof, we claim that the part of x in the direction of g, is given by an oblique 
projection operation P k defined by 



P k {x) = g,(g k • x) , with no summation on k . 



(6.41) 



The three P k operators are complementary projections because they satisfy the following 
properties: 



Pi(Pj(x)) 



Pfe) if i=j 
if i*j 



(6.42) 
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and 

P l (x)+P 2 (x) + P 3 (x) = x (6.43) 

Generalized projections 

GOAL: Reiterate the mathematician's definition of the term "projection" (idempotent) 
A transformation P is called a projection (or "idempotent") if and only if 

P(P(x)) = P(x), (6.44) 

which merely states that projecting a vector that has already been projected will give you 
the same projected vector right back. Consider, for example, the function of Eq. (6.17): 

n , N a(b • x) 

P(x) = JC-=^= — =^ (6.45) 

q • b 

Physically, we know that this function is a projector. To prove it rigorously, we operate on 
both sides of Eq. (6.45) by P to obtain 



P(P(x)) 



a\b • 

q(b »x)' 

a • b . 



a(b»x) 
« • b 



« • b 



(6.46) 



Simplification shows that the right hand side reduces back to P(x) . Hence, Eq. (6.44) 
holds and P is indeed a projection. 

Linear projections 

GOAL: Define very special (linear) class of projectors, explain that oblique projectors are 
also linear. 

A projection is linear if and only if 

(i) P(ax) = aP(x) , for all a , and 

(ii) P(x l +x 2 ) = P(x l ) + P(x 2 ) for all x { and x 2 . (6.47) 

The projection of Eq. (6.45) is easily seen to be linear even though it is oblique. Likewise, 
Eq. (6.41) is linear. Physically, a projection is linear if one can take the projection of a lin- 
ear combination of vectors and the result is the same as you would get if you instead first 
projected the individual vectors and then took their linear combination. 

Nonlinear projections 

GOAL: To clarify linear projections, give examples of some nonlinear projections. 
The vector "signum" function. An example of a nonlinear projection is 

P(x) = -^— (or P(x)=0 if x=0) (6.48) 

Jx»x 
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This function is indeed a projection because Eq. (6.44) holds. The first linearity test (i) in 
Eq. (6.47) fails because, for example, P(2x) ^ 2P(x) , so this projection is nonlinear. 
Geometrically, the above operator transforms a vector to a unit vector in the same direc- 
tion. Hence, the range set for this transformation consists of vectors pointing from the ori- 
gin to a point on the unit sphere. The transformation of Eq. (6.48) is non-linear because 
the range (the target surface of the sphere) is geometrically curvilinear. The level lines 
(i.e., the "light rays") are straight lines that emanate radially from the origin. 

The vector signum operation always returns a unit vector in the direction of the start- 
ing vector, or the zero vector if the starting vector is zero. The signum operation is some- 
times more compactly denoted with a "hat" so that 

x = ~ (oxx=0iix=0) (6.49) 

Jx»x 

For lengthy operands, the "hat" signum operation is sometimes abbreviated "sgn" or is 
indicated by a "hat" as a superscript on the end of an expression. For example, 

a + b 

sgn(a + b) = ~ ~ ~ or sgn(« + b)=0 if (a + b)=0 (6.50) 

||« + A|| 

Gravitational (distorted light ray) projections. Nonlinear projectors can also 
be constructed for which the range is a linear manifold (i.e., a line or a plane) but the path 
to this range space is curvilinear. For example, the transformation 

P(X) = [*'g-(***) 2 ]g (6 .51) 

q • (q-b) 

is a projection because P(P(x)) = P(x) . It has a linear range space (vectors parallel to 
a), but the projection is nonlinear because the paths to the range space (i.e., the level 
lines) are curvilinear. The light rays are bending as they approach the target space. 

A very important nonlinear projection transformation from the field of continuum 
mechanics is the polar decomposition (see page 206). Rather than being additive, this 
decomposition is multiplicative. 

Self-adjoint projections 

GOAL: Show that orthogonal (nearest point) projections are self-adjoint, whereas oblique 
projections are not. Set stage for later showing that orthogonal projection tensors are 
symmetric, whereas oblique projection tensors are not . 

A projection P is self-adjoint if and only if 

*i * P(y) = Y • P(u) for all u and v . (6.52) 

Applying this definition to Eq. (6.45) gives 



u • 



a(b • v) 

v - - 



q • b 

Simplification gives 



v • 



a(b • it) 
a • b . 



(6.53) 
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(u • q)(b • v) = (v • q){b • u) for all u and v . (6.54) 

This condition can be true only if a is proportional to b * in which case the projection 
reduces to the orthogonal (nearest point, high noon) projection of Eq. (6.12). The P k pro- 
jectors defined in Eq. (6.41) are not self-adjoint unless the {g, } basis is orthonormal. 
Physically, self-adjoint projections correspond to projections to the nearest point in the 
target space (like a shadow at high-noon), whereas non-self- adjoint projections are 
oblique (like a shadow in late afternoon). 

Later on, we will see that linear projectors can be represented through the use of pro- 
jection tensors. Then we will find that a linear projector is self-adjoint only if its projection 
tensor is symmetric. 

Gram -Schmidt orthogonalization 

GOAL: show how to convert a set of vectors into a minimal orthonormal basis that will span 
the same space as the original set of vectors. 

Suppose that you are working on a problem involving a collection of ordinary engi- 
neering vectors. For illustration, suppose that your collection contains four vectors 
{ Vj, y 2 , v 3 , v 4 } . Our goal is to construct an orthonormal basis for the span of any collec- 
tion of vectors, regardless of whether or not they are linearly independent. One process for 
doing this is called Gram-Schmidt orthogonalization, and it involves simply a sequence of 
projections and normalizations as outlined in the following step-by-step sequence of cal- 
culations: 

n l = sgntvj] (6.55) 

n 2 = sgn[v 2 -(v 2 • «,)«,] (6.56) 

« 3 = sgn[v 3 -(v 3 • n l )n l — (v 3 • « 2 )« 2 ] (6.57) 

« 4 = sgn[v 4 -(v 4 «« 1 )« 1 -(v 4 «« 2 )« 2 -(v 4 «« 3 )« 3 ] (6.58) 

Recalling the definition of the vector signum function "sgn" given in Eq. (6.50), we note 
that the first of these equations normalizes the first vector Vj (or simply gives zero if Vj is 
zero). Note the similarity between Eq. (6.56) and Eq. (6.12), which shows that n 2 is sim- 
ply the (normalized) part of v 2 perpendicular to n l . The remaining equations cited are 
similar; they systematically create vectors that have a zero dot product with the preceding 
vectors. Since our example involved four starting vectors, we know that at least one — 
possibly more — of the above «, vectors will turn out to be zero. Even if the starting col- 
lection had contained only three vectors, it's still possible for one of the n k vectors to 
come out to be zero. The appearance of a zero n, vector is merely an inconsequential by- 
product that occurs whenever the starting collection not linearly independent. The non- 
zero n, vectors form a basis for the span of the original starting set of vectors. Therefore, 
the number of nonzero n k vectors equals the dimension of this span. 



* To prove this claim, take ulb and v=b to obtain (u • a)(b • b) = or, since b * by implied 
premise, u • a = . In other words, u±q for all ulb . Thus, a must be proportional to b . 
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Special case: orthogonalization of two vectors. One distasteful aspect of the 
Gram-Schmidt orthogonalization process is that the resulting basis depends on the order- 
ing the starting vectors. There's nothing particularly wrong with this. To orthogonalize two 
vectors, u and v in a less biased manner, you might consider the following alternative 
approach: 



Define m 



u , v 

-^- and n = rfh- 



\\u\\ \\v\\ 

Then an orthonormal basis can be defined as 



Si s 



in + n 

\m + n\ 



and 



?2 S 



m-n 



\m - n\ 



(6.59) 



(6.60) 



There remains a small amount of bias here because exchanging u and v will change the 
direction of e 2 . 



The projection theorem 

Some of the most profoundly useful engineer- 
ing theorems merely state intuitively obvious con- 
cepts in a more useful (but less obvious) 
mathematical form.* 

The projection theorem is another mathemati- 
cal statement of a physically "obvious" concept. 
Namely, you can always break a vector into a part 
in a desired direction plus whatever is left over. 
Now let's state this idea mathematically. 

Given a projector P, the projection theorem 
states that any vector x can always be decomposed 
uniquely as 

X = x p +x@ 

such that x p is in the range space of the projector P and x,Q is in the null-space of the pro- 
jector P . By this we mean that x p and X.Q will satisfy 




Figure 6.7. Oblique projection. 
The path obliquely intersects the plane. 



(6.61) 



P(x p ) = x p 
p (x Q ) = Q 



(6.62) 
(6.63) 



The vector x p is the projection of x, and xQ is simply the part of x that is "left over" 
after taking away x p . Specifically, 



x 



Q 



P(x) 
Q(x), 



(6.64) 
(6.65) 



* For example, the principle of conservation of mass merely asserts that "what goes in must come out 
or stay there." The mathematical representation of this statement is more useful, but less obvious. 
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where 

Q(x) = x-P(x) (6.66) 

The function Q is itself a. projector. Some key properties of these "complementary" 
projectors are 

P(P(x)) = P(x) Q(Q(x)) = Q(x) 
P(Q(x)) = Q(P(x)) = q 

P(x) + Q(x) = X (6.67) 

Note that P(Q(x)) is not the same thing as x p • xQ . If the projection is oblique, then 
x p • xQ will be nonzero, but P(Q(x)) will always be zero for complementary projectors. 
The transformation P(x) is an orthogonal projection if and only if P is self-adjoint, in 
which case x p • xQ will also be zero. 

The projection theorem is just the mathematical way to describe what is fairly obvious 
from looking at Fig. 6.7 (i.e., a vector can be broken into its shadow plus whatever is left 
over). The projection theorem becomes quite useful (and less obvious) in higher dimen- 
sional spaces. Later in this book, we will introduce the notion of an abstract vector. Under 
this definition, we will find that matrices, differentiable functions and many other seem- 
ingly unrelated things behave just like vectors. The fact that a scalar function f(x) can be 
written as the sum of its even plus odd parts is an application of the projection theorem. 
The fact that a matrix can be written as the sum of its symmetric plus skew-symmetric 
parts is an application of the projection theorem. The fact that a continuously differential 
function can be expressed as a Taylor series is the projection theorem (the basis is the infi- 
nite set l,x, x 2 , x 3 , ... ). 

Most material constitutive laws are expressible in terms of projections. For example, 
the projection theorem allows us to decompose stress and strain tensors into their devia- 
toric plus isotropic parts. Hooke's law of linear elasticity states that these individual parts 
are proportional to each other (i.e., pressure is proportional to volumetric strain and the 
stress deviator is proportional to the strain deviator). The proportionality constant is not 
necessarily equal for the two parts, so stress itself is not proportional to strain. 
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"No matter how much cats fight, there always 

seem to be plenty of kittens." 

— Abraham Lincoln 



7. Tensors 

If you're sitting at a cocktail party with a bunch of engineers, physicists, and mathe- 
maticians, and you want to start a heated debate, just ask out loud: "What is a tensor?" 
One person will say that, for all practical purposes, a tensor is just a fancy word for a 
matrix.* Then someone else will pipe up indignantly and insist that a tensor is a linear 
transformation from vectors to vectors. Yet another person will say that a tensor is an 
ordered set of numbers that transform in a particular way upon a change of basis. Other 
folks (like us) will start babbling about "dyads" and "dyadics." In this chapter, we will 
touch on each of these various perspectives and urge you to adopt whatever definition of 
the term tensor you feel most comfortable with. As long as your definition implies the 
other guy's definition and vice versa, then either definition is acceptable.! 

You can't study tensors without eventually (sometimes secretly) becoming enamoured 
of one particular definition of tensors. We will ease you into the notion of tensors by dis- 
cussing how engineering tensors arise naturally when working with linear vector transfor- 
mations. We will then describe our personal favorite (and less frequently adopted) 
definition of a tensor as being a sum of new abstract "objects" called "dyads." Admittedly, 
the dyad definition is not very satisfying or particularly intuitive, but we like it anyway 
because this definition requires no mention of a basis, per se, but it leads directly into the 
supplemental concept of a tensor basis, and it generalizes seamlessly to abstract, higher- 
dimensional, settings. From there, we will be poised to then cover the definition of an 
engineering tensor in terms of basis transformation rules. 



* This is true for some practical purposes, but not for all practical purposes. 

t Often, determining if one definition implies the other is a difficult task. The person who defines a 
tensor according to basis transformation rule is actually defining & particular class of tensors, 
whereas the definition in terms of linear transformations has broader abstract applicability, but 
becomes bogged down in the more subtle question: what is a vector? Answering this question for 
engineering mechanics applications eventually also comes around to the need to introduce basis 
transformation criteria, so in this arena, both definitions are equivalent. See page 227. 
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Analogy between tensors and other (more familiar) concepts 

GOAL: Explain how vectors share several axiomatic properties in common with smooth 
scalar-valued functions. Then demonstrate that tensors are quite similar to smooth 
functions of two variables. 

The mathematician's abstract definition of a vector, discussed on page 230, is ele- 
gantly crafted to call attention to the fact that certain seemingly unrelated sets of objects 
often share common properties. By studying sets with these properties in an abstract set- 
ting, mathematicians are able to derive numerous general results. Once done, they know 
that the results apply to any sets objects that obey those properties — no matter how unre- 
lated those sets might appear to be at first glance. 

This section will step through several observations about continuous smooth functions 
that you probably already know from your elementary algebra and calculus classes. Then, 
the parallel or analogous observations about vectors and tensors will be made in order to 
show the similarity between smooth functions and vectors. The goal here is to de-mystify 
the subject of tensor analysis by showing that it is very similar to other branches of mathe- 
matics where you are likely to be already comfortable. 

Applying the mathematician's definition of a vector (page 230), it can be shown that 
the set of all real smooth functions of one variable is itself a vector space, and we will 
denote it by C^ . The subscript "co" is used to tell you that this space is infinite dimen- 
sional' and the superscript "1" is telling you that the space is a first-order (i.e., vector) 
space. Any member of C^ is usually written f(x) , where x is permitted to take any value 
in the set of real numbers, and the actual symbol used for it is inconsequential. By analogy, 
we will denote the set of ordinary engineering vectors by the symbol V\ , where the sub- 
script "3" indicates that engineering vectors are three-dimensional, and the superscript "1" 
indicates that the set V\ is a first-order space (vectors). A member of V\ is usually 
denoted in indicial form by v ; , where "z" is an index that is permitted to take any integer 
value from 1 to 3, and the actual symbol used for it is inconsequential. Note the analogy: 
the indicial notation v ; is analogous to the function notation f(x) . The vector index i , 
which takes values from 1 to 3, is analogous to the independent variable x , which takes 
values from -co to <x> . 

Applying the mathematician's definition (page 233), we can define the inner product 
between two smooth functions, /eCj, and g e C^ by 

f-g = \f(x)g(x)dx, (7.1) 

where the integration over the dummy variable x extends over the permissible range of x 
(namely from x=-co to x=+co). By analogy, the inner product between two engineering 
vectors, / e V\ and g e V\ is defined 

f'g^YfiSi, (7-2) 



* infinitely differentiable 

f It's infinite dimensional because, if you tried to describe a function such as y = x 2 using a table of 
(x,y) pairs, your table would have to have an infinite number of entries. 
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where the summation over the dummy index "/" extends over the permissible range of "z" 
(namely from i=\ to i=3 ). Note the similarity between Eqs. (7.1) and (7.2). One involves 
a continuous summation (i.e., integration) over the independent variable and the other 
involves a discrete summation over the index. 

We know that there exist coefficients a ; such that any smooth function can be 
expressed in the form of a power (Taylor) series: 

f(x) = a + ajX + a 2 x 2 + a 3 x 3 + ... (7.3) 

Viewed differently, this tells us that the set of smooth functions {x k } , for k = 0, 1,2, . . . , 
forms a basis for C^ . Any smooth function can be written as a linear combination of this 
basis. The number of members of the basis equals the dimension of the space (infinite). 
Analogously, we know in 3D vector analysis that there exist coefficients f i such that any 
vector / can be expressed in the form 

/ = /l€l+/2€2 + / 3 €3 ( 7 - 4 ) 

where the set {e t } , for i = 1,2, and 3, forms a basis for V\ . Any engineering vector can 
be written as a linear combination of this basis. The number of base vectors equals the 
dimension of the space (three). 

Any smooth function can alternatively be expressed in the form of a Fourier series, for 
which the associated basis consists of trig functions. The coefficients in a Fourier expan- 
sion are not equal to the coefficients that appear in Eq. (7.3), although knowledge of those 
coefficients can be used to deduce the correct coefficients in the Fourier expansion. Like- 
wise, any engineering vector can alternatively be expressed as an expansion in terms of 
some alternative basis {e*} , for which the coefficients are not equal to those in Eq. (7.4), 
although knowledge of those coefficients can be used to deduce the correct coefficients 
with respect to the new basis. Note the analogy: changing from a power series to a trig 
series expansion of a smooth function is the same (in spirit) as performing a change of 
basis in 3D vector analysis. 

When discussing the overall properties of a smooth function f(x) , people will often 
refer to it as simply "/'; this removal of the independent variable helps readers stay 
focused on the fact that the function itself 'is being discussed, not the result of applying the 
function to an independent argument. Of course, actual calculations or applications of the 
function/will require reintroduction of the independent argument. Similarly, when people 
speak about vectors, they often refer to them in structured (AKA symbolic, direct, or 
"Gibbs") notation as v ; this removal of the explicit presence of the component index "z" 
helps readers focus on the true physical meaning of the vector. Actual calculations involv- 
ing that vector will, of course, require reversion back to index notation. 

The concept of smooth functions having only a smg/e-argument (i.e., members of C^ ) 
can be extended to consider binary (two argument) smooth functions. We denote this new 
class of function by C 2 , where the superscript "2" indicates that members of this class of 
"objects" have two arguments. Members of C 2 will be written in the form F(x, y) , where 
the arguments, x and y , are permitted to take on real values from -oo to +co , and the 
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symbols that we use for these arguments are inconsequential (i.e., F(r, s) would denote 
the same function as F(x, y)). Analogously, we will introduce in this section the concept 
of an engineering tensor. We will denote this new class of "object" by V\ , where the 
superscript "2" indicates that we are discussing second-order tensors and the subscript 3 
is again denoting the dimension of the underlying physical space. Members of V\ will be 
written indicially in the form F- , where the indices, i andy, are permitted to take on inte- 
ger values from 1 to 3, and the symbols that we use for them are inconsequential (i.e., F rs 
would denote the same tensor as F- ). Note the analogy: second-order engineering tensors 
are similar in spirit to functions of two variables. 

A binary function F(x, y) can be used to transform a single-argument function v{y) 
to become a new function u(x) through the special operation 

u(x) = ^F(x,y)v(y)dy. (7.5) 

where the integration extends over the permissible values of the second argument y (i.e., 
the integral goes from y=-cc to y=+co ). The binary function F(x, y) fully dominates and 
characterizes the nature of the transformation. Analogously, we will find that the dominant 
role of engineering tensors is to characterize a primitive operation that transforms a single 
engineering vector v to become a new vector u . In particular, this operation is written in 
index form as 

where the summation extends over the permissible values of the second index "/' (i.e., the 
sum goes from j=\ to /— 3 ). Note the analogy between Eqs. (7.5) and (7.6); one integrates 
over the second dummy integration variable while the other sums over the second dummy 
summation index. 

Recognizing where analogies do and don't exist between seemingly unrelated fields of 
study can be indispensable. Talented researchers are often able to use what they know 
about a one subject to help them learn a new subject. Careful researchers are diligent to 
spend as much time identifying where the analogies break down as where they apply. 
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Linear operators (transformations) 

GOAL: Set stage for the "linear transformation" definition of a tensor by showing how a 3 x 3 
matrix arises naturally to characterize all information needed to compute how a linear 
vector-to-vector operation transforms its independent vector argument. Emphasize that this 
"component" matrix contains numbers that are tied to the choice of basis. Set stage for both 
the dyadic definition of a tensor and the component transformation definition. Introduce the 
notion of basis dyads. 

Let f denote a vector-valued function of a vector. The symbol / denotes a set of 
instructions. The operator is not itself a vector — its output is a vector. Let x be the vector 
supplied as an argument to the function, and let y be the result of applying the function. 
Then we would write, y = f(x) . 

The function is linear if and only if 

f(a l x l + a 2 x 2 ) = aj/^j) + a^Cx^) 

Equivalently, the function / is called "linear" if and only if 

(i) /(otv) = a/(v) for all scalars a 

and (ii) f{u + v) = /(«) +f(v) for all vectors u and v (7.7) 

Linearity gives you freedom to apply the operator to a linear combination of vectors in 
either of two equivalent ways: (1) you can take the linear combination of the vectors and 
directly apply the operator / or (2) you can apply the operator separately to each of start- 
ing vectors and then take the linear combination of the individual results. 

If we know how a linear function transforms the three base vectors, then linearity lets 
us quickly determine how the function transforms an arbitrary vector. To see why this is 
so, let's define three f. vectors to be the transformations of the orfhonormal basis vectors: 

/i=/(Si)> L^Mi^ and / 3 s /(? 3 ) ( 7 - 8 ) 

Importantly, these three vectors can be computed once and saved for all time. Usually 
these vectors are stored as columns of a 3 x 3 matrix [F] so that 

[F] = [{£}{&} {&}] ( 7 - 9 ) 

In other words, F- is the i ,h component of/. . More precisely, 

F. = e.*f. o f = F tj e. (7.10) 

IJ ~l Jj Q lj~l "■ 

Recall that an arbitrary vector x may be written 

x = Xjgj + x 2 e 2 + x 3 e 3 (7.11) 

Operating on this vector by the linear function f and applying the linearity property, 
shows that the action of the linear transformation on an arbitrary vector v can be rapidly 
computed by 

fiX) = x i/(€i) + x /(€ 2 ) + x 3/(€3) 

= x 1 / 1 +x 2 / 2 + x 3 / 3 (7.12) 

Using the summation convention, 
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fix) = Xjfj (7.13) 

Substituting Eq. (7.10) into Eq (7.13) gives 

fix) = XjiF^J = (FyXj)^ (7.14) 

If we let the vector y denote the result of f{x) , then we write 

y=f(x)=y i e i . (7.15) 

Thus, the z th component of f(x) is obtained by the simple matrix multiplication, 
yi = F ijXj ,or 

{y} = [F]{*} (7.16) 

The matrix [F] is called the matrix of components of the "tensor" associated with the 
linear transformation f. These components are relative to the basis {e x , e 2 , g 3 } that we 
used to compute the /, vectors. Using a different basis will result in a different [F] com- 
ponent matrix. 

For any linear function, there exists an associated tensor, and vice versa.* Conse- 
quently, many authors [e.g., 20] define a tensor to be any linear transformation of vectors 
to vectors.! We prefer to keep the two ideas separate in our presentation. After all, we fre- 
quently know the linear transformation (i.e., the set of instructions) before we know the 
tensor itself. | For example, when b is a known constant vector, the cross product opera- 
tion f(x) = b x x is linear with respect to x . However, the tensor associated with this 
operation is not immediately obvious. The operation is linear, so we know that a tensor 
(representable by a matrix) must exist, but what is the tensor component matrix that corre- 
sponds to f{x) = b x xl Not obvious. 

It is critical to recognize that the components of the matrix F- are, by construction, 
referenced your chosen basis. Thus, implicitly, a tensor must consist of both a matrix of 
components and an associated basis. If the basis changes, then the component matrix 
changes in a specific way (explained later), which is why some people [e.g., 19] define a 
tensor to be a set of components that transform in the necessary way upon a change of 
basis. 

The intimate dependence of the F- components on the underlying basis {e v e 2 ,e 3 } 
is well emphasized by using the following basis notation for tensors: 



* This claim is called the Representation Theorem, and it will be discussed in more detail on 
page 122. For now, take this statement as an unproved truth. 

t As clarified by Simmonds, "...To say that we are given a 2nd order tensor T means that we are told 
7"s action on (i.e., where it sends) any vector v. Thus two 2nd order tensors S and T are said to be 
equal if their action on all vectors is the same..." 

{ The distinction is analogous to the unique correspondence between animals and their DNA 
sequences. Disregarding cloning and identical twins, there is exactly one animal for each DNA 
sequence and vice versa, but this does not mean that animals and DNA sequences are the same. 
Likewise, in tensor analysis, one often has a well-characterized linear transformation without hav- 
ing an explicit expression for the associated tensor (even though we know it exists). 
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F= F n ( €l (x) €l ) + F 12 ( €l (x) €2 ) + F 13 ( ?1 ® € 3) 

+ F 2l {e 2 ®e x ) + F 22 (e 2 <8> g 2 ) + F 23 (e 2 ® g 3 ) 
+ F 3 i(e 3 ®e l ) + F 32 (e 3 ®e 2 ) + F 33 (e 3 ®e 3 ) (7.17) 

The dyadic multiplication "(H)" symbol is defined below. For now, the presence of g. <8> g. 
next to F. . should be regarded as a way to indicate that the F- matrix of components is 
defined relative to the {e v g 2 , e 3 } basis. In this form, F is often called a "dyadic," but 
we will simply continue to use the term "tensor." 

The above expansion may be written compactly using the summation convention as 

F = F ij (e i ®e j ) (7.18) 

We will usually omit the "<8>" symbol for dyadic multiplication so that two vectors written 
side by side are understood to be multiplied dyadically, and the above equations would be 
written more compactly as 

% = F n e l e l +F 12 g 1 g 2 + F 13 g 1 g 3 

+ F 3l e 3 e x +F 32 e 3 e 2 + F 33 e 3 e 3 (7.19) 

and 

F = F iMj ( 72 °) 



If F is the tensor associated with a vector-valued linear transformation of vectors, 
f{x) , then we introduce the following notation: 



F • x means the same thing as fix) 



(7.21) 



Most authors do not use our double underline (under-tilde) convention to indicate the 
order of a tensor, so you will typically see tensors typeset simply in bold, F. Furthermore, 
many authors do not use the raised dot notation (hence, to them, Fx means the same thing 
as what we write as F • x . As will be further explained later, our notation lends itself bet- 
ter to heuristic "self-explanatory" interpretations of the intended meanings of operations, 
which becomes indispensable when working with higher-order tensors in modern material 
modeling applications. 



Recall that many people define a tensor to be a linear operation taking vectors to vec- 
tors. The basis dyad e.e, is itself a tensor, and it has a component matrix that contains all 
zeros except for a 1 at the ij position. Thus, the matrix form of Eq. (7.19) is simply 
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+ ^33 





1 




1 




1 



(7.22) 



This basis/matrix correspondence is completely analogous to the act of writing a vector in 
basis form as 



Vi?i + v 2 £ 2 + v 3 e 3 



(7.23) 



and then interpreting this expression using matrix notation as 



'Y 




Y 




V 
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< v 2 


> = Vj< 





> + v 2 < 
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> + v r 
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V 3„ 














1 



(7.24) 
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Dyads and dyadic multiplication 

GOAL: Define, cite properties 

The "®" symbol represents "dyadic multiplication," also frequently referred to as a 
"dyadic product" [24]. A dyad [35] between two vectors a and b is an abstract mathemat- 
ical construction denoted q <8> b that takes on meaning when it operates on an arbitrary 
vector v as follows: 

(q® b) • v = q(b • v) for all vectors v (7.25) 

A dyad has physical meaning only when operating on a vector. Alone, it is a mathematical 
bookkeeping device that can be independently manipulated but has no inherent meaning 
in its own right. 

Two dyads q ® b and r ® s are said to be "equal" if and only if 

(q® b) • v = (r®s) • v for all vectors v (7.26) 

Note that the right hand side of Eq. (7.25) equals the vector a times a scalar, (b • v) . 
Thus, (q ® b) • v is proportional to q . Similarly, (b ® «) • v would be proportional to b . 
Thus, dyadic multiplication does not commute. That is, 

a® b*b®q in general (7.27) 

Applying the definition of a dyad (namely, Eq. (7.25)) to both sides of Eq. (7.26), note that 
two dyads a ® b and r ® s are equal if and only if 

?(£ • Y) = €(* • Y) f° r au vectors v (7.28) 

It is straightforward (but somewhat tedious) to show that, for nonzero vectors, 

a® b = r®s only if r = a« and s = p6 where ap = 1 . (7.29) 

In other words, the vector r must be proportional to a and s must be proportional to b . 
The condition on the proportionality constant is equivalent to requiring that a • b = r*s. 
If a and/or b is zero, then a <S> b = r®s only if r and/or s is zero. 

The above discussion reiterates that dyadic multiplication does not commute; i.e., 

q®b*b®q (7.30) 

Referring to Eq. (7.29), we obtain the necessary and sufficient condition for q® b to 
commute: 

q® b = b® q if and only if b = aq for some a . (7.31 ) 

In other words, the two vectors in the dyad would have to be multiples of each other in 
order for a dyadic multiplication to commute. 
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Simpler "no-symbol" dyadic notation 

GOAL: Advocate in favor of not using the dyadic multiplication symbol. 

Whenever two vectors are written side-by-side with no "<8>" symbol between them, 
they are understood to be multiplied dyadically. Thus, 



ab means the same as a ® b . 



(7.32) 

In addition to being a more compact notation, this convention for dyadic multiplication 
also has the appealing property that the definition of Eq. (7.25) can be written 

(qb)»v = q(b»v), (7.33) 

which allows us to drop the parentheses without ambiguity.* We advocate retaining the 
explicit "(§)" symbol only when it is needed for clarity. 

Dyads are like defensive linemen in football — essential, but rarely of much interest 
per se. Dyads are merely abstract mathematical objects, which (up to this point) have no 
apparent practical use. After we define addition and scalar multiplication for dyads, we 
will see that tensors (which are of great practical importance) are always expressible as a 
linear combination of the nine possible dyads between the orthonormal base vectors. 
These nine basis dyads, {e x e x , e x e 2 , ...,e 3 e 3 } , form a basis for tensors just as the three 
base vectors {e v e 2 , eA form a basis for ordinary vectors. With the "no symbol" nota- 
tion, Eq. (7.18) may be written in basis notation as 

F = F ij e i e j , (7.34) 

In this expression, the indices i and / are summed from 1 to 3. Thus, the above expression 
is a linear combination of dyads, the meaning of which is described in more detail below. 

The matrix associated with a dyad 

GOAL: Show that a dyad has an associated 3x3 matrix that is equivalent to the outer 
product of the vectors. Set stage for making connection between dyads and tensors — both 
have associated matrices. Dyads are special kinds of tensors. 

The right-hand side of Eq. (7.33) is a vector whose z th component is 

a^bjVj) (7.35) 

We can define a 3x3 matrix whose ij components are ap- . Then the expression in Eq. 
(7.35) can be written 

[afijlvj (7.36) 



Some people strenuously object to this side-by-side notation for dyadic multiplication. They argue 
in favor of the "®" symbol because dyadic multiplication is "different" from scalar multiplication. 
By the same logic, however, the identity (y + P)v = yy + |3y should also be notationally objection- 
able because addition between vectors is "different" from addition between scalars. Likewise, the 
notation dy/dx would be objectionable because derivatives are not really fractions. In both mathe- 
matics and engineering, we routinely overload operations for good reason: heuristic notational 
advantages. The meanings of the overloaded operations are implied by the nature of the arguments. 
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This can be written as a matrix equation 



a i b \ 



a^b 2 



a 2 b \ a 7p2 



a i b \ 



a l b 1 



a l b i 
a 2 b 3 

a l b 3 ' 



3 J 



(7.37) 



which is the matrix representation of the left-hand side of Eq. (7.33). Using conventional 
matrix notation, note that 



[<?*] 



a 1 b l 

a 2 b \ 
a 3 b \ 



a l b 2 
a 2 b 2 

a 3*2 



a 2 b 3 
a 3 b 3 



{a}<b> 



(7.38) 



The result is a square matrix. You should contrast this operation with the similar-looking 
scalar-valued operation of Eq. (5.3) in which the transpose merely occurs in a different 
place! 

The operation in Eq. (7.33) is a linear transformation of the vector v resulting in a new 
vector, q(b • y) . Consequently, as discussed on page 99, this operation has an associated 
3x3 matrix, which it turns out to be identical to the matrix in Eq. (7.38). For example, 
Eq. (7.9) showed that the first column of the matrix associated with a linear transformation 
f(x) is given by fie^ . In the present context, our linear function is f(v) = q(b • v) , so 
the first column of the associated matrix should contain q(b • e x ) , and (recalling Eq. 
5.13), we see that this is indeed the first column of the matrix in Eq. (7.38). 

The sum of dyads 

GOAL: define, cite properties 

The sum of two dyads, qb and cd, is an abstract notion defined such that 

(qb + cd) • v = q(b • v) + c(d • v) for any vector v (7.39) 

The sum of three dyads, qb + cd + ef is defined such that 

(qb + cd + ef) • v = q(b • v) + c(d • v) + e(f* v) for all v (7.40) 

The sum of two or more dyads takes on meaning only when operating on a vector. The 
sum of dyads also has a matrix interpretation. Specifically, the matrix [qb + cd] associ- 
ated with the sum of two dyads is obtained by simply adding the matrices for [qb] and 
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A sum of two or three dyads is NOT (generally) reducible 

GOAL: Show that the sum of two or three dyads cannot always be rearranged to become 
just a single dyad — the sum of dyads is itself a new object. It is a superset (i.e., the set of 
all dyads is a subset of the set of all sums of two dyads, but not vice versa). 

By applying the definition of Eq. (7.39) it's straightforward to prove that 

(?/ , + !? < / = ?(/> + < 7) ( 7 -41) 

This is a very special situation in which the sum of two dyads can be written as a single 
dyad (between the vector q and the vector p + q). 

In general, the sum of two dyads cannot be expressed as a single dyad. One cannot 
generally find two vectors r and s such that qb + cd = rs. Thus, the sum of two dyads is 
itself a distinct new abstract object. The sum of three dyads is also a distinct mathematical 
abstraction that in general cannot be written as either a single dyad or the sum of two 
dyads. We will later demonstrate that the sum of four or more dyads can always be 
reduced to the sum of three or fewer dyads (provided that the vectors belong to ordinary 
3D space). Thus, the sum of four or more dyads is not a new object. 

The set of all "objects" that are expressible as a sum of two dyads is a "superset" of the 
set of all dyads because any single dyad can be written in the form qb + 00 . Likewise, 
objects expressible as the sum of three dyads is a superset of objects expressible as the 
sum of two dyads. 

Scalar multiplication of a dyad 

GOAL: Define this operation, cite properties, emphasize that scalar multiplication can act 
on any of the individual vectors forming a dyad. 

The multiplication of a scalar y with the dyad qb is a new dyad denoted y(qb) , and is 
naturally defined such that 

[y(«£)] • Y = Y(?(* * Y) f° r a11 Y ( 7 - 42 ) 

Using the dyad symbol for clarity, we note that the scalar multiple may be regarded as an 
external multiplier or it may be absorbed into any one of the vectors in the dyad: 

y(«®6) = (yq)®b = («y)®6 = q®(yb) = q <8> (by) (7.43) 

No matter where the scalar is placed (on the right side of the dyad or between the two vec- 
tors), it can always be moved to the left side. In other words, 

qyb and qby mean the same thing as y(qb) . (7.44) 

Thus, scalar multiplication requires no parentheses. 

Scalar multiplication of a sum of dyads is defined as you might expect. Namely, 

y(qb + cd) = (yqb + ycd) 

y(qb + cd+ ef) = (yqb + ycd + yef) (7.45) 
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The sum of four or more dyads is reducible! (not a superset) 

GOAL: Show that the sum of more than three dyads (in 3D) can always be reduced to the 
sum of three or fewer dyads. 

The sum of four or more dyads is defined by natural extension of the definitions of 
Eqs. (7.41) and (7.40). Thus, for example, the sum of four dyads is defined so that, for all 
vectors v , 

(qb + cd + ef+ gh) • v = q(b • v) + c(d • v) + e(f* v) + g(h • v) (7.46) 

In typical engineering applications, vectors are ordinary vectors in 3D physical space. 
Consequently, any set of four vectors must be linearly dependent. Thus, at least one of the 
vectors in the set, {b, d,f, h} , can be written as a linear combination of the other vectors. 
Suppose, for illustration, that the dependent vector is h . Then there exist a k scalars such 
that 

h = 046 + a 2 d + 013/ (7.47) 

Hence, the dyad gh can be written 

gh = (a. l g)b + (a 2 g)d+(a 3 g)f (7.48) 

and therefore, 

qb + cd+ ef+ gh = (q + a^)b + (c + a 2 g)d+ (e + a 3 g)f (7.49) 

The left-hand side is the sum of four dyads. The right hand side is the sum of three dyads. 
This proves that any sum of four or more dyads can always be reduced to three or fewer 
dyads. Consequently, the sum of four or more dyads is not a new abstract object! The sum 
of any number of dyads is generally referred to as a dyadic, but we will use the term 
"tensor." 

The dyad definition of a second-order tensor 

GOAL: Use result of previous section to define a "tensor" to be any dyad or sum of dyads. 

The function f[v] = q{b • v) is linear in v . The dyad qb is the tensor associated with 
this linear transformation. Dyads are the most rudimentary tensors. As emphasized earlier, 
the sum of two dyads generally cannot be reduced to a single dyad. Likewise, the sum of 
three dyads cannot be reduced to the sum of fewer dyads. However, the sum of four or 
more dyads can always be reduced to the sum three or fewer dyads. Consequently, a sec- 
ond-order tensor may be defined as any sum of dyads. The term "dyadic" is also used to 
mean the same thing. This definition is equivalent to the more traditional definition of a 
tensor in terms of linear transformations from vectors to vectors in the sense that one defi- 
nition implies the other. The "sum of dyads" definition is more useful in certain settings, 
especially when considering a tensor as a higher-dimensional vector. 
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For clarity, we typeset second-order tensors in bold using two under-tildes. Thus, A , 
B , U would denote second-order tensors. Tensors are extremely useful in physical appli- 
cations. For example, tensors represent stress, strain, rotational inertia, electrical permit- 
tivity, and many other important physical quantities. Once a physical quantity is proved to 
be representable by a tensor, a wealth of theorems from abstract tensor analysis then apply 
to the tensor, furthering its physical interpretation. 

Expansion of a second-order tensor in terms of basis dyads 

GOAL: show that expanding an ordinary engineering tensor as a linear combination of the 
NINE possible ways to form basis dyads is similar in spirit to expanding an ordinary 
engineering vector as a linear combination of the laboratory orthonormal basis. 

A dyad is the most rudimentary form of a tensor. Many people think of a tensor as simply 
a 3 x 3 matrix. Most of the time, that view is adequate. However, the components of a ten- 
sor s matrix are always referenced to a particular basis. If the basis changes, then the 
matrix changes. As discussed later, the matrix corresponds to a tensor if and only if the 
matrix changes in a particular manner upon a change of basis. Since the preceding state- 
ment contained the phrase "if and only if the component transformation property is 
sometimes taken as a definition of the term tensor. For now, however, we shall continue 
with our equivalent view of a tensor as a sum of dyads. 

For a three-dimensional vector space (i.e., for a space V\ where vectors have three 
components), the sum of two dyads cannot generally be written as a single dyad. Like- 
wise, the sum of three dyads generally cannot be reduced to the sum of fewer dyads. How- 
ever, as proved earlier, any sum of more than three dyads can always be reduced to the 
sum of three or fewer dyads. From this observation, we offered the very abstract definition 
of a "second-order tensor" to be any sum of dyads. Knowing that such a sum can always 
be written as the sum of at most three dyads, one might be tempted to wrongly conclude 
that tensors form a three dimensional space; however the three dyads are not the same for 
all tensors — in fact, they are not even unique for any given tensor. To determine the 
dimension of the space of tensors, we need to determine how many scalars are needed to 
uniquely define a tensor. 

Given a tensor A {i.e., given a sum of dyads), we know that there exist vectors such 
that 

A = qb + cd + ef (7.50) 

Each of the vectors may be expanded in terms of a basis (a = a f e., etc.), in which case, 
the first term would become qb = agpfe- . Using the property of Eq. (7.44), this can be 
written 

ab = aft/e^; (7.51) 



* Keep in mind, we only need to assert that these vectors exist. In practice, the appropriate vectors are 
almost never actually computed. Furthermore, they aren't even unique. 
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Performing similar expansions for the other terms in Eq. (7.50), we see that any sum 
of dyads (i.e. any tensor) can be written as a linear combination of the nine possible basis 
dyads g.g. for i andy" ranging from 1 to 3. That is, for any tensor A , there exist scalar coef- 



•i~j 



ficients (called components) A u such that 



4 = A if~i e ~j 



(7.52) 



where there are an implied sums of i andy ranging from 1 to 3 for a total of nine terms. 
The principal advantage of the representation in Eq. (7.52) is that the A t - components are 
unique for a given orthonormal basis, just as the components of an ordinary vector are 
unique for a given basis. 

The A-. components of tensors are often displayed in 3x3 arrays like this: 



14] 



11 


^12 


^13 


21 


^22 


^23 


31 


^32 


^33_ 



(7.53) 



Let A be a second-order tensor. In terms of an orthonormal basis {e v e 2 , g 3 } , the ten- 
sor A may be written 



4 = IXM*/ 

t = iy = i 

or, using Einstein's summation convention, 



(7.54) 



Vi*/ 



(7.55) 



It's crucial to realize that these components are referenced to a particular basis. When 
working with more than one basis, the component matrix might be subscripted with ee , as 
in the expression 



141 



^11 A \2 A \3 

A 2l A 12 A 23 

A n A i2 A 33 



(7.56) 



The ee subscript tells you that the ij component of the matrix is the coefficient of e ( e- in 
the basis expansion, A = A-e-e,. Another way to indicate the associated basis is to 
append the name of the basis in angled brackets after the listing of the matrix. Thus, for 
example, 



W = 



A \\ A n A n 

A 2l A 22 A 23 
^31 ^32 ^33 



<lab> 



(7.57) 



would indicate to the reader that the components are referenced to the laboratory basis. 
Finally, the notation 
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<e 3 =n> (7.58) 



would tell the reader that the component matrix [A ] is being displayed with respect to a 
special purpose basis in which the 3 -direction has been aligned with a known unit vector 
n . This sort of display would be used when the component matrix is particularly simple 
with respect some particular (cleverly selected) basis. See, for example, our discussion of 
transverse isotropy on page 224. 

Triads and higher-order tensors 

GOAL: Introduce higher-order tensors 

Recall that we introduced the concept of second-order tensors by discussing linear 
transformations from vectors to vectors ( V\ to V\ ). From there, we introduced the primi- 
tive "new object" called a dyad, and defined a tensor to be any sum of dyads. That defini- 
tion was really for second-order tensors. Any second-order tensor can be expressed as a 
linear combination of the nine basis dyads. This idea can be extended by introducing a 
triad to be a new object formed from three vectors qbc , defined such that 

(qbc) • v = qb(c • v) for all vectors v (7.59) 

Addition and scalar multiplication of triads is defined similarly to that of dyads. Also, as 
was the case for dyads, you can show that scalar multiplication is vector-wise commuta- 
tive, which means that multiplying a triad by a scalar will give the same result as multiply- 
ing any of its constituent vectors by that scalar: 

y(qbc) = (yq)bc = q(yb)c = qb(yc) = (qbc)y (7.60) 

As was done for second-order tensors, we can recognize that there are twenty-seven 
(3x3x3) ways to form triads out of various combinations of the lab base vectors. A 
third-order tensor is defined to be any linear combination of the basis triads, and it can 
be characterized by a three-index 3x3x3 matrix. We will indicate third-order tensors by 
using "under-tildes" and the basis expansion for a third-order tensor H can be written as 

f = H^egje, (7.61) 

A third-order tensor characterizes the action of a linear operator that takes vectors to sec- 
ond-order tensors. If Y is a second-order tensor given by a linear operation, Y = H(x) , 
then, recalling the "advanced" discussion surrounding Eq. (9.17), there exists a third-order 
tensor H such that 7- = H ijk x k . Similarly, a third-order tensor characterizes a linear 
operator that takes second-order tensors to vectors. The alternating tensor (whose compo- 
nents with respect to a right-handed orthonormal basis equal the alternating symbol) is a 
good example. In rigid body mechanics, the alternating tensor can be used to convert the 
angular velocity vector into the angular velocity tensor. Conversely 1/2 times the alter- 
nating tensor is the operator that will convert the angular velocity tensor back into the 
angular velocity vector. 
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These concepts extend to even higher-dimensional tensors. In materials modeling, 
fourth-order tensors play a dominant role because material models typically represent a 
set of rules for which a second-order tensor, such as the strain, is transformed to give a dif- 
ferent second-order tensor, such as stress. Even if the transformation is non-linear, it will 
nevertheless still be linear in rate form, as will be discussed later. That's why it is so 
important to study linear operations. Virtually all nonlinear functions in real physical 
applications become linear in rate form, which therefore permits tapping into the rich liter- 
ature available for solving linear problems. 

Because a third-order tensor has three indices, each taking values from 1 to 3, a third 
order tensor has 27 components. A fourth-order tensor has 81 components. 



Our V m n tensor "class" notation 

GOAL: Define the meaning of V m n and show that any tensor of class V m n will have m n 
components. 

Recall that engineering scalars, vectors, second-order tensors, third-order tensors, and 
fourth-order tensors are specified by 1, 3, 9, 27, and 81 numbers, respectively. Scalars are 
often called th -order tensors. Vectors are sometimes called 1 st -order tensors. In general, 
an « th order engineering tensor has 3" components, and we say that these tensors are of 
class VI . 

When solving a problem for which all tensors are have isotropic symmetry about some 
2D plane embedded in 3D space, it is conventional to set up the basis so that the third base 
vector points perpendicular to that plane. Doing this permits the 3D problem to be reduced 
to a 2D problem where vectors now have only 2 nonzero components and second-order 
tensors are characterized by 2 x 2 matrices. 

When working in two dimensions, an rc th order engineering tensor has 2" compo- 
nents. Similarly, when working in an m-dimensional manifold (which is the higher dimen- 
sional version of a plane), an n th order engineering tensor has m" components, and we 
say that it is of class V^ . 

It will be explained later that a second-order tensor of class V^ is also a first order 
tensor of class V]^ . For example, an ordinary second-order engineering tensor (class V\ ) 
is also a first-order vector in a 9-dimensional space (class V\ ). Just as you can speak of 
planes embedded in ordinary 3D space, you can also limit your attention to subspaces or 
linear manifolds with 9D tensor space. The set of all symmetric second-order engineering 
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tensors, for example, is closed under tensor addition and scalar multiplication. By this we 
mean that any linear combination of symmetric tensors will be itself a symmetric tensor. 
Symmetric tensors (which have six independent components) can be regarded as a six- 
dimensional vector, and we say that they are of class V\ . 

When you consider a problem in ordinary 3D space where most of the action occurs in 
a plane, then (unless that plane happens to be lined up with the laboratory basis) your anal- 
ysis will undoubtedly simplify if you introduce a different orthonormal basis that is 
aligned with the plane. Similarly, when considering symmetric tensors embedded within 
9D tensor space, your calculations will simplify if you switch away from the conventional 
e-e basis used in 9D space in favor of a different basis that is "aligned" with symmetric 
tensors. For example, instead of using e x e 2 as one of your base-tensors, you would 
instead use e l e 2 + e 2 e l , which is symmetric. All of the other base tensors would need to 
be redefined as well if you want to switch to a basis that is aligned with symmetric tensors. 
To see how this change-of-basis would go, note that the component expansion for a gen- 
eral (not necessarily symmetric) tensor given in Eq. (7.22) can be written equivalently as 



F n F \i F n 

F 2\ ^22 F Ti 
F 31 F 32 F 33 



1 

^11 





+ 



+ 



r F 23 +F 32^ 
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1 




1 




33 



31 





1 

1 



1 



F l2 + F 2l 



1 

1 





0-1 
1 



1 

-10 



(F 



21 



12 



0-10 
1 




(7.62) 



The matrices shown on the right-hand-side of this equation can be regarded as an alterna- 
tive basis for 9D tensor space that is aligned with symmetric tensors. This basis is still 
capable of describing arbitrary non-symmetric tensors (just as a three-vector basis whose 
first two base vectors are contained within a plane in ordinary 3D space is still capable of 
describing all vectors, including those not in the plane). If [F] happens to be symmetric, 
then F 23 = F 32 , F 31 = F 13 , and F l2 = F 2l , and the above expansion reduces to 



F u F n F n 

F 2\ F 22 F 23 
F 31 ^32 F 33 



1 






1 






+ F 2 

1 




1 
1 



1 
F 3l 

1 



1 

1 




(7.63) 
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Thus, if you are dealing exclusively with symmetric tensors, then you only need six base 
tensors. The components with respect to these base tensors are called Voigt components. 
One disadvantage with the Voigt system is that the base tensors are not unit tensors, but 
that problem can be easily rectified by normalizing the Voigt basis to obtain what's called 
the Mandel basis. The key point here was that the set of all symmetric tensors really needs 
only six base tensors. Consequently, this set is of class V\ . 

Fourth-order engineering tensors are of class V\ , but they are also of class V$ . In 
other words, a fourth-order tensor referenced to ordinary 3D space can be regarded as a 
second-order tensor referenced to an abstract 9D space. Consequently, they can be manip- 
ulated in computations by using a 9 x 9 matrix, with the indices ranging from 1 to 9 corre- 
spond to physical space index pairs 11, 22, 33, 23, 31, 12, 32, 13, 21. If you limit attention 
to fourth-order tensors that are minor symmetric, then the last three columns and last three 
rows of this 9x9 matrix will contain all zeros. In other words, you will be dealing only 
with the upper 6x6 part of the matrix. Consequently, minor-symmetric fourth-order ten- 
sors are of class V\ and they have at most 6 2 , or 36, nonzero components. 

An ability to change how you regard the class of a tensor is useful in materials 
mechanics. For example, in plasticity, the trial elastic stress rate is found by assuming that 
a material is behaving elastically. If it is found that this assumption would move the stress 
into a "forbidden" region that violates the yield condition, then plastic flow must be occur- 
ring. The set of admissible elastic stresses is defined by a yield function such that 
/(a) < . When a is regarded as a vector of class V\ , then f(o) = defines a yield sur- 
face in 6D space. For example, just as the equation x • x - R 2 = defines a sphere of 
radius R in ordinary 3D space, the equation g:<j - R 2 = would define a hypersphere in 
6D stress space. When the trial assumption of elastic behavior is found to move the stress 
into inadmissible stress states (i.e., those for which f(o) > 0), then [8] the equations gov- 
erning classical nonhardening plasticity can be used to show that the actual stress rate is 
obtained by projecting the trial elastic stress rate onto the yield surface. The projection 
operation that is similar in structure to the projection shown in Fig. 6.3 except that the vec- 
tor dot product is replaced by the tensor inner product (: ). The outward "normal" B that 
defines the target plane is the gradient of the yield function (i.e., B-- = df/do^. These 
sorts of statements are implicitly regarding stress (and the yield surface normal) as tensors 
of class V\ . 
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Comment 

So far, we have covered two important definitions of the term "tensor." We will delay 
discussing the definition that is cast in terms of basis transformation rules until we can 
cover some basic tensor operations using the definitions we have given so far. This discus- 
sion will lead us into a discussion of how a tensor's matrix is related to the underlying 
basis, at which time, the basis transformation rules should make enough sense to under- 
stand why many people define tensors according to these rules. 
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"Seriousness is the favorite refuge of 
the shallow. " — Oscar Wilde 



8. Tensor operations 

Dotting a tensor from the right by a vector 

Keep in mind that a tensor is a mathematical bookkeeping device, which takes on 
physical meaning only when operating on a vector. The notation A • v represents the lin- 
ear transformation associated with the tensor. Specifically, applying the definition of a lin- 
ear combination of dyads, the notation A • v must be interpreted as 

In the second-to-last step, we have used Eq. (5.13) to write e- • v = v . Comparing the far 
left and far right-hand sides of Eq. (8.1) we conclude that 

A • v is a vector whose i th component is A-v- . (8.2) 

Thus, the components of A • v may be obtained by the matrix multiplication [A] { v} . 

The transpose of a tensor 

The transpose of a tensor A is a new tensor denoted A T and defined in direct notation 
such that 

u • (A T • v) = v • (A • «) for all vectors w and v (8.3) 

The z/ component of A T is denoted ^. In indicial notation, the above definition 
becomes 

uAT.v- = v A u (8.4) 

ii] J m inn n v^-^l 

We would like to change the dummy summation indices on the right hand side so that we 
may compare it to the left hand side for arbitrary vectors u and v . That means we want 
the index on components of u and v to be the same on both sides. Replacing n by i and 
replacing m by /' , the above equation becomes 

u i A ii v J = v J A Ji u i < 8 - 5 ) 

Rearranging gives 
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"Mfj-AjJVj = (8.6) 

The only way this can hold for all vectors u and v is if 



A T = A 



(8.7) 



The above equation is often cited as the definition of the transpose, but the direct notation 
definition of Eq. (8.3) is more general since it makes no assumption that the underlying 
basis is Cartesian. 

It is straightforward to show that 

(aA) T = aA T (8.8) 

and 

(A+B) T = A T + B T (8.9) 

Thus, the transpose operation is linear. The transpose of a dyad qb is obtained by simply 
swapping the order of the vectors. Namely, 

(qb) T = bq (8.10) 

If a tensor is written in the form of Eq. (7.55), the transpose simply swaps the base 
vectors. Specifically, 

4 T = (Aj^jV = A iMi e ~j) T = A ij e ~j e ~i = A n e ~i e ~j ( 8 - 11 ) 

i j, in last step, change 

V f dummy index i toy 

swap and y to/ 

In writing the final form, we have merely emphasized that any symbol may be used for the 
dummy subscripts. Namely, we may swap the symbols i and /' without loss. The ji com- 
ponent of A T is the coefficient of e,e t ; so the second-to-last expression says that 
Aj t = A t -. The final expression says that the ij component of A T is the coefficient of 
e t e , namely A •• . Both statements are equivalent — they just use different free index sym- 
bols to describe the same result! 

Dotting a tensor from the left by a vector 

We will define the notation u • A to be a vector defined such that 

(u • A) • v = u • (A • v) for all vectors v (8.12) 

Following an analysis similar to Eq. (8.1) we write 

u •A = u • (Age^j) = Ayiu • g f )g/ = 4/«,-)S/ = (M/;)S/ ( 8 - 13 ) 

Thus, 

u • A is a vector whose /'* component is u^A^ . (8.14) 

Equivalently, changing the symbols for the indices, 
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u • A is a vector whose i th component is u-A- t 



(8.15) 



For both Eqs. (8.2) and (8.15), the index that is summed is on the same side of the [A] 
matrix as the dot product (u is dotting into A from the left, and the summed index on A t - 
is the left index). The transpose of A is a new tensor A T defined such that (A T ).. = A- t . 
Thus, we note that 



Likewise, 



u • A -- 


- 4 T * U ~ 


je, 


A • u -- 


~- u*A T 



(8.16) 



(8.17) 



Dotting a tensor by vectors from both sides 

The notation u • A • v is defined in a notationally consistent manner. Namely, 

u»A»v = (u •A)* v = u • {A • v) = UjAj-v- (8.18) 

There are no free indices, so this result is a scalar. 

For advanced analysis, it is often useful to recognize that 

V *4 • Y = 4 :l iY = tY : 4 (8.19) 

Where ": " is the tensor inner product defined later in Eq. (12.1). 

Extracting a particular tensor component 

Using techniques similar to those used to derive Eq. (5.13) one can prove that 



A : 



e t »A* e- 



4 : m 



By virtue of Eq. (8.12), parentheses are not needed in this formula. 



(8.20) 



Dotting a tensor into a tensor (tensor composition) 

Heuristically, you may infer the meaning of A • B by expanding each tensor in its 
basis form as follows 



4 • f = A ij e ~i e ~j • B kis&i 

Applying Eq. (7.44), this may be written 
A • B = A u B, ] e-e i • e h e, 

a a I) kl~l~J ~/r~/ 

Applying Eq. (5.8), we note that g. • e k = 8- k so that 
4*2 = A ij B ki^jk€i 



(8.21) 



(8.22) 



(8.23) 
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Again applying Eq. (7.44), this may be written 

4^= A ij B kfijk^l ( 8 - 24 ) 

Finally, using the Kronecker-removal rule (Eq. 4.43), we may eliminate the 8 - k if all 
occurrences of the summed index / are replaced with k, giving 

4*% = A Aim < 8 - 25 ) 

This result is a linear combination of A ik B kl times the dyad g.g.. Therefore, A • B must 
represent a tensor whose il component is given by A ik B kl . Later on, the linear transforma- 
tion operator associated with A • B will be seen to represent the composition of the linear 
transformations associated individually with A and B . 
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"Everything comes to he who hustles while 
he waits. " — Thomas Edison 

9. Tensor analysis primitives 

Three kinds of vector and tensor notation 

Three kinds of notations dominate the literature: direct, basis, and indicial. "Direct," or structured, 
notation uses underlined symbols with no reference to a basis. Indicial notation shows strictly the compo- 
nent form of an expression. Basis notation is similar to indicial notation except that the associated basis is 
shown explicitly. 

Rather than giving formal definitions, we will merely show the distinctions by examples: 

Example 1 : Representations of a vector 

direct: v (no indices, no base vectors) 

basis: v i e i (no free indices, one base vector — > result is a vector) 

indicial: v- (one free index — > result corresponds to a vector) 

Example 2: A linear transformation of a vector 

direct: A • v (no indices, no base vectors, abstract operation symbol) 
basis: (A n v i )e i (no free indices, one base vector — > result is a vector) 
indicial: A t -v- (one free index — > result corresponds to a vector) 

Example 3 : The composition of two tensors 

direct: A • B (no indices, no base vectors, abstract operation symbol) 
basis: (A-.B- k )e i e k (no free indices, two base vectors — > result is a tensor) 
indicial: A .J?- (two free indices — » result corresponds to a tensor) 

Example 4: The inner product of two vectors 

direct: q • b (no indices, no base vectors, abstract operation symbol) 
basis: a k b k (no free indices, no base vectors — > result is a scalar) 
indicial: a k b k (no free indices — > result corresponds to a scalar) 
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When counting base vectors in an expression given using basis notation, it is important to 
understand that this count must occur after the expression has been simplified into a form 
that is identical to the indicial form except also multiplied by the base vectors correspond- 
ing to the free indices in the indicial expression. For example, (a,-g.) • (b k e k ) is expressed 
using basis notation, but the presence of two base vectors does not mean it corresponds to 
a tensor; the dot product between e i and e k becomes simply 8 jk so that the expression 
simplifies to afifi^ or simply a k b k , which has no base vectors and is therefore a scalar. 

Direct notation is useful for conceptual discussions. As long as the abstract operations 
are well-defined, it is straightforward to convert from direct notation to any of the other 
notations. The principal disadvantage of direct notation is that the meanings of the 
abstract operations can vary widely in the literature. For example, many authors define the 
notation A v to mean what we have opted to denote by A • v . Also, it is often more diffi- 
cult to infer the order of the result when using direct notation. It is a bit easier, though, 
with our "under-tilde" convention. To infer the order of the result, first you count the num- 
ber of under-tildes (for example, A • v has three under-tildes); then you subtract from this 
number by an amount appropriate to operations in the expression. For example, the "sin- 
gle" dot operation will always reduce the count by 2. Three minus two equals one; there- 
fore, A • v must be a first-order tensor (i.e., a vector). The cross product operation will 
reduce the count by 1. The double dot operation ":" (see Eq. 3.60) reduces the count by 
four. 

An extremely important use for direct notation arises in vector and tensor calculus, 
where the meaning of, say, the curl for an obscure curvilinear coordinate system can be 
simply "looked up" in a handbook. Likewise, the appropriate component form for, say, the 
dot product for a non-rectangular basis can be looked up in a handbook. You can perform 
all of your physical analyses in Cartesian indicial form and then simply express the final 
result in direct notation. As long as every step in your analysis involved valid vector and 
tensor operations (vector addition, dot products, cross products, dyadic products, gradient 
operations, etc.), then straightforward rules exist to convert your final direct notation 
result into any other notation or to any other coordinate system without error — it is not 
necessary to re-do your entire analysis when you switch notations or coordinates! 

Direct notation formulas also tend to exhibit more obvious connections with similar 
formulas for scalars. For example, the time rate of the inverse of a tensor is given by 

d{F~ l ) dF 

-f — = -r 1 • -£ • r 1 , (9-1) 

dt dt ~ 

which is clearly analogous to the scalar formula 



d\- 



dx/dt .Q 2 - 



dt x 1 
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Tensor gradients are another good example. We can define direct notation symbols for the 
derivative of scalars, vectors, or tensors with respect to other scalars, vectors, or tensors as 
follows: 

ds ds du Su i du du; 

— = — e, , — - = — ee , — — = eee,, etc. (9.3) 

dx dx k ~ k ' dw dwj-'-J' dA dA Jk ~*J~ k ' { ' 

By using a notation such as this, direct notation expressions for the chain rule take forms 
that are very similar to what is already familiar for scalars. For example, it can be shown 
that 

rV - t < 94 » 

dw] du 

Suppose, as another example, that a scalar s is given by a function of another scalar 
\\f , a vector a , and a tensor F . If each of these arguments is expressible as a function of 
position x then the gradient of s with respect to position can be computed in direct nota- 
tion by using the chain rule: 

ds_ _ ds_d^_ + ds_ # dq + ds_ § ££ 
dx d\\i dx da dx 8F ' dx 

where the ":" symbol denotes the second-order tensor inner product, defined later. This 
formula looks like an ordinary application of the chain rule except that the appropriate 
inner product is used between factors. The indicial form of the above equation would be 

8s_ = ds_dy + ds_^ + ds ^mn 

dx t dx\fdx t da k dx t 8F mn dx t 

Basis notation is useful when working with more than one basis, or as an intermediate 
notation when converting a direct notation expression to indicial form. Indicial notation is 
often the most clear, though an alphabet soup of indices can be distracting when discuss- 
ing conceptual issues. Furthermore, the constant task of looking after the summation rules 
(changing /' 's to k 's, etc.) can be wearisome and error-prone. There are times when even 
indicial notation is vague. For example, what does the expression df/do ti mean? Is it 
5/73(tra) or is it tr[3//3a]? The two are not the same. Likewise, does AtS mean 
{A~ l ).. or 1 / A t - . Sometimes these questions can be answered by defining operator prece- 
dence* or simply from context. Nonetheless, these issues are characteristic of potential 
flaws with indicial notation. The bottom line is that all three notations are useful, and none 



* A good rule of thumb is that the indices take lowest precedence. Thus Aj 1 would be found by tak- 
ing the inverse of A and then finding the ij component. 
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is perfect. A competent analyst should learn all notations and pick the one that is clearest 
for the application at hand. A courteous analyst will always attempt to infer and use 
whichever notational system their audience (or the majority of their audience) will be 
most comfortable with. 



REPRESENTATION THEOREM for linear forms 

GOAL: Explain that there exists a unique tensor that characterizes each function that 
linearly transforms vectors to vectors. 

If a vector-valued function f(x) is known to be linear, then there exists a second-order ten- 
sor F which is independent of x such that the function f(x) can be written in the form 
F • x . Stated mathematically, 

If f(x) is a vector valued function that is linear in x , then there exists a tensor F 
such that f(x) = F • x , where F will be independent of x . (9.7) 

The converse is also true. Specifically, any expression of the form F • x can be proved to 
be linear with respect to x if you can prove that F is independent of x . This might seem 
like an obvious statement, but it can be subtle in certain applications.* 

If f(x) is linear in x , then the equation y = f(x) can (and should) be written 
y = F • x , which is expressed in indicial notation as 

(9.8) 



)'i 



F V X J 



where the associated base vector e • is understood to be multiplied by these components. If 
the vectors x and y are written as 3x1 matrices and the tensor F is written as a 3x3 
matrix, Eq. (9.8) can be written 



>'2 
1^3 J 



^11 ^12 ^13 

*21 ^22 ^23 
^31 ^32 ^33 



1 3J 



(9.9) 



Incidentally, we have used the phrase "if f(x) is linear in x " as a sloppy way to indicate 
that the function / might depend additionally on other variables that we have not shown 
explicitly in the independent variable list. If, for example, you are dealing with a function 
f(x, ()), c) where § is a scalar and c , then this function is said to be linear in x if 



/"(at* + pv, <|>, c) = af(u, <k c) + p/(v, $, c) 



(9.10) 



For example, if R represents an orthogonal tensor defined such that R • x will rotate a vector x by 
an angle a about an axis a , then you can use this operation in a description of torsion of a circular 
rod to describe the movement of points on the rod. However, for torsion, the angle of rotation 
increases with distance along the rod. Hence, since R depends on the angle of rotation, it must also 
depend on position. Consequently, R • x would be a nonlinear transformation of x despite the fact 
that it appears on the surface to be linear because the spatial dependence of R is not shown explic- 
itly. There's nothing wrong with this, but you do need to monitor possibilities like this. 
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for all scalars a and p and all vectors u and v . In this case, there exists a tensor F that 
will be independent of x but will generally depend on § and c such that 
f(x, ((), c) = F(§, c) • x . If the function f depends on § and c in a nonlinear manner, 
then so will the tensor F . 

Representation theorem for vector-to-scalar linear functions. 

Our statements about existence of tensors corresponding to linear functions were 
given above in the context of vector-to-vector transformations. However, the same idea 
applies to tensors of other orders as well. If, for example, g(x) is a scalar-valued function 
that depends linearly on its vector argument x , then you can assert existence of a vector g 
such that g(x) = g • x . 

If f{x) is a sca/ar-valued function that is linear in x , then there exists a vector g 

such that f(x) = g • x , where g will be independent of x . (9.11) 

Consider, for example, the equation s = (bxx) • q, where q and b are known con- 
stant vectors. The right-hand-side of this expression is linear with respect to x . Conse- 
quently, we should be able to construct a vector g that depends on q and b but not on x 
such that s = g • x . To find g , the simplest method is to write the requirement 

(bxx)»q = g»x (9.12) 

in indicial form. Namely, 

& ijk b j x k a i = S/^k ( 9 - 13 ) 

Since this must hold for all x k , we conclude that 

8k = Zijk b j a i ( 9 - 14 ) 

or 

g = qx b (9.15) 

In hindsight, you might look at this result to see that you could have done the entire proof 
in direct (structured) notation by noting that (b x x) • q is the triple-scalar-product, 
[b, x, q] and, by the cyclic property of the triple-scalar-product, you could assert that it 
must equal [q, b, x] or (« x b) • x . It is more easy to compare this re-written expression 
with g • x to immediately recognize that g = q x b . In practice, elegant solutions like 
this one might be difficult to see a priori, and doing it indicially is often easier. 

Incidentally, note that the index "£" on the right side of Eq. (9.13) is only a dummy 
index. It was just fortunate happenstance that the same dummy index was on x k on both 
sides of that equation. You must never go from an equation like (9.13) to a conclusion like 
(9.14) unless you have the dummy indices all matching on the variable you wish to "can- 
cel". If we had been inattentive and written the indicial form of g • x as g i x i , then 
Eq. (9.13) would have read 

& ijk b j x k a i = Si x i ( 9 - 16 ) 
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This is a legitimate indicial equation (no summation conventions are violated), but it 
would be incorrect to simply remove the x's to write e IJk b j a j = gi ; doing that would violate 
the sum conventions because "z" would be a dummy sum index on the left side but a free 
index on the right side. When facing a situation like this one when the indices are not all 
identical on the variable you wish to "cancel" you can use the methods on page 67 to 
manipulate the indices to desired symbols. Before you "cancel" a variable x k , however, 
you must assert that the equation holds for all x k (see Eq. 5.11). 

Advanced Representation Theorem (to be read once you learn about 
higher-order tensors and the V m n class notation). 

We have described the representation theorem for vector-to-vector transformations 
and for vector-to-scalar transformations. The representation theorem applies to any func- 
tion that linearly transforms a vector or tensor of class Vf into V^ . The representation 
theorem ensures existence of a tensor of class Vf + n that characterizes the linear function. 
Specifically, the linear form can be written as this Vf + n tensor multiplied by the input 
argument using the inner product for the input space, Vf . 

If f(x) is a Fj" -valued function that is linear with respect to a Vf tensor x , then 
there exists a V™ " tensor H such that f(x) = H*x , where * is the inner 
product on Vf and H will be independent of x . (9.1 7) 

Suppose, for example that h(x) is linear transformation of a vector x that produces a 
second-order tensor as its output. The input x is of class V\ and the output (a second- 
order tensor) is of class V\ . Because the transformation is linear, you can assert the exist- 
ence of a tensor of class V\ + 2 , or V\ that characterizes the transformation using the inner 
product on the input space. The input space is V\ , which is just ordinary vectors, so the 
inner product there is just the single raised dot. Thus, if h(x) is linear transformation of a 
vector x that produces a second-order tensor as its output, then there exists a third-order 
tensor H such that h{x) = H • x . 

The argument to a linear function doesn't have to be a vector. Materials modeling, for 
example, deals with transformations that take tensors to tensors (e.g., given strain, the 
model will compute stress). In this case, we are considering linear transformations from 
V\ to V\ , so these can be characterized by a tensor of class V\ + 2 , or fourth-order V\ 
tensors, acting on the input space using the V\ inner product. Thus, if f(X) is a linear 
function that produces a second-order tensor as output, then you may assert existence of a 
fourth-order tensor E such that f(X) = E:X . Note that we are no longer using the single 
dot product. We are using the double-dot ~product because that is the inner-product appro- 
priate to the argument of the function. If Y = f(X) , then Y = E:X, which can be written 
in component form as Y- . = E ijkl X kl . You can also consider scalar-valued functions of 
tensors. Consider, for example, the trace of a tensor g(X) = trX. This function is linear in 
X, so we may assert existence of a tensor G such that g(X) = G:X . For this example, it 
turns out that G is the identity tensor, so we may therefore write trX = I:X . 
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Why all this fuss over linear functions when we know that Mother Nature plagues us 
with non-linear phenomena? The answer is that linear transformation theory is a generali- 
zation of what you learned in high-school about straight lines. The mathematics of straight 
lines forms the essential foundation for calculus, where nonlinear functions are handled by 
regarding them as an infinite collection of tiny straight line segments. Physical applica- 
tions of tensors to nonlinear transformations employ similar principles, as will be dis- 
cussed in Chapter 21 . 

Finding the tensor associated with a linear function 

So far, we have only asserted that a tensor F exists whenever the function f(x) is linear. 
In practical applications, the fastest way to construct the F- matrix is to recognize that the 
I th column of [F] contains the components of the vector f(e) . 



For analytical applications, an indicial expression for the tensor is often desired, and 
this indicial expression can usually be cast in direct notation as well. 

Method #1. The conventional way of finding the tensor associated with a linear trans- 
formation is to write out the ";' th " component of f(x) in indicial form and then set the 
result equal to the indicial form of F • x , namely F-x- . In this expression, note that the 
index "/' is a dummy summation index, and we could have equally well written F ik x k . 
You should take care to choose the same symbol for the dummy sum index on x every- 
where so that you can then assert that the result must hold for all x , permitting you to drop 
the x k 's from the indicial equation. This approach is used in Eqs. (11.21) and (11.22). 

Method #2. The tensor F can be determined by simply differentiating the function f(x) 
with respect to x . 

f if j = Ax) 1 

[and/(x) is linear in x) 

then there exists a tensor F such that y = F • x 

dy dy t 
where F = — = —e-e- (9.18) 

ax oxj~ J 

An example of this statement is given in Eq. (11.23). Incidentally, the derivative 
8( )/dx- denotes the partial derivative with respect to x . , holding the other components 
of x constant. When applying Eq. (9.7) for finding F, it is often important to recognize 
that the derivative of a vector with respect to itself is the identity tensor /, as defined 
below. 
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This formula is applied, for example, in Eq. (11.25). Unlike method #1, this method does 
not require you to spend time trying to get the dummy summation index to be the same on 
all x k , which can be difficult for complicated expressions. 

Method #3. A related "slick" method for finding the tensor is to express the equation 
f(x) = F • x in rate form. Taking the rate of the right-hand side (permitting only x to be 
regarded as time varying) gives F • x . The rate of f(x) can typically be easily rearranging 
into a form of "something" dotted into x and that "something" must be the tensor F . 

EXAMPLE. Consider, for example, the vector-to-vector function f(x) = (c»x)c, 
where c is a constant vector. This function is linear with respect to which is linear with 
respect to x , so you can assert existence of a tensor F such that f(x) = F • x . 

METHOD #1 : The z' th component of f(x) is c n x n c i , and this result must be equated to 
the I th component of F • x , namely F in x . Note that we used the dummy index symbol 
"n" on x n to ensure that it would be the same as the index used in our first expression. 
Equating the two expressions gives c n x n c i = F jn x n . Asserting that this must be true for 
all x n shows that F in = c n c r 

METHOD #2: In indicial form, the equation f(x) = F*x can be written 
c n x n c i = F ? ik x k ■ This time, we didn't bother to get the dummy sum index the same on 
both x's. Differentiating both sides with respect to x gives c n 8 l c ■ = F jk 8, . Using the 
index-changing property of the Kronecker delta, this simplifies to c c ■ = F- , which is 
the same as what we got using method 1 . 

METHOD #3: For our example function, the equation f(x) = F»x is 
(c • x)c = F • x . Taking rates gives (c • x)c = F • x rearranging so that the x is on the 
trailing end of both expressions gives c(c • x) = F • x . Asserting this must hold for all x 
shows that F = cc, which is the direct notation version of the result found using methods 
1 and 2. This example was a bit trivial, so the power of this method is not readily apparent. 



The identity tensor 

Consider the following function 

f(x) = x (9.20) 

Applying Eq. (7.7), this function is seen to be linear in x . Therefore, applying Eq. (9.7), 
there must exist a second-order tensor, which we will denote /, such that 

I*x = x for all x (9.21) 



Recalling Eq. (9.19), the ij components of / with respect to any orthonormal basis are 
ply §,y • 

The 3x3 matrix for the second-order identity tensor / is just the identity matrix 



simply 8 f . 
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[/] 



1 
1 
1 



with respect to any ortho-normal basis. 



(9.22) 



Thus, in basis notation, the identity tensor may be written 



5 .m 



or, expanded out explicitly, 



C- 1 C 1 "T" C- "\ %*■ "\ ' %Z 3 C- "2 



e ~k e ~k 



(9.23) 



(9.24) 



An alternative way to derive Eq. (9.22) is to recall that the i th column of the tensor must 
contain /(g) . Thus, the first column of the tensor must contain the component array for 
f(e,) = gj . The component array for e l is 



(9.25) 



so this must be the first column of the matrix. The second and third columns are the com- 
ponent arrays for e 2 and g 3 , respectively. Thus we obtain the same matrix as in Eq. 
(9.22). 

Tensor associated with composition of two linear 

transformations 

* 

Recall that for any linear vector-to-vector transformation, f(x) , there exists a tensor 
F such that 



fix) = F*x 



(9.26) 



Likewise, for any linear vector-to-vector transformation, g(x) , there exists a tensor G 
such that 



Therefore, the composition of the two transformations must be given by 
/&(*)) = F.(G.x) 



(9.27) 



(9.28) 



The composition of two linear functions can be readily verified to be itself a linear func- 
tion. Hence, recalling Eq. (9.7), there must exist a tensor, which we will denote F • G 
such that 



fUzQs)) = (F • (?) • x f° r a ^ vectors x 
The components of F • G are 



(9.29) 



from the Representation Theorem, Eq. (9.7) 
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Hence, the matrix for F • G may be found by the simple matrix multiplication, [F][G] . 

Eqs. (9.28) and (9.29) must both hold simultaneously for all x vectors. Hence, the 
direct notation statement, 

(F»G)»x = F»(G»x) for all* (9.31) 

serves as a definition of what is meant by F • G . 

The power of heuristically consistent notation 

In Eq. (9.31), we have chosen a heuristically appealing notation for F • G so that we 
may drop the parentheses to write 

F *Q*x (9-32) 

without ambiguity. Many authors prefer the more-easily typeset notation FG to denote 
the composition, so they would not be able to drop the parentheses. Our notation is more 
consistent because you can always heuristically decipher what it means. For example, 
recalling that 

F = Fy^j and G = G kl e k e t , (9.33) 

you can heuristically write 

F • G = (Fyefi) • (G kl e k eJ = F^G^e^) . (e k ej (9.34) 

Using Eq. (5.8), the user can note that e- • e k = 8 /k , so that the above equation would 
become 

F'G = F ij G k fi jk e i e l (9.35) 

Finally, noting that 8 ^ is zero unless, j=k, this becomes 

F • G = F^Guea (9.36) 

The remaining dyad is e j e l . Hence, the il components of F • G must be 

{F.G) n = F ik G kl (9.37) 

Aside from our choice of dummy and free indices, this result is identical to (9.30). 
Throughout this book, we define our notation in such a manner that heuristic analyses like 
these will always give the correct interpretation of the notation. Thus, for example, the 
cross product between a tensor and a vector would be interpreted 

4 x v ~ = ( A ij e ~i e ~j) x ( v a) 

= ( A ij v k?i)(?j x St) ( 9 - 38 ) 

Applying Eq. (5.33), the above equation becomes 
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A x v = AtjVtBpjtBfy (9.39) 

This final form contains a dyad e t e . The reader (who might never have heard of crossing 
a tensor into a vector) would be able to conclude that A x v must be a second-order tensor, 
with ip components given by 

(4 x % = V*^* (9 - 40) 

Similarly, a reader would be able to deduce what it means when we write two tensors writ- 
ten side-by-side with no symbol between. Following our notational conventions, the result 
is a fourth-order tensor, 

4? = A ij B ki^Mi ( 9 - 41 ) 

We have already introduced the notion that any linear combination of g . 's is a vector, and 
any linear combination of e.e. dyads is a second-order tensor. Generalizing this idea, we 
will later introduce basis "triads" e e e, which will be identified with third order tensors. 
Likewise, any linear combination of e-ee k e, must be a fourth-order tensor. Hence, the 
notation AB in Eq. (9.41) must represent a fourth-order tensor whose ijkl components 
must be A tj B kl . Recall that u ® v means the same thing as hv. Likewise, when publish- 
ing for a journal article, it might be wise to use the notation A® B instead of AB because 
your readers might confuse AB with tensor composition, which we here denote as A • B . 

The inverse of a tensor 

Recall from Eq. (9.29) the two notations for the composition of two linear operators f 
and g 

f(g(x)) = (F • (?) • x for all vectors x (9.42) 

Now suppose that f is defined to "undo" the action of g so that 

f(g(x)) = x for all vectors x (9.43) 

Then f is called the inverse of g, and is denoted g~ l . The tensor associated with the 
inverse of g is denoted G~ l . Hence, putting Eq. (9.43) into (9.42) gives the tensor defini- 
tion of the inverse: 

x = {G~ l • G) • x for all vectors x (9.44) 

In other words, the tensor inverse is defined such that 

G~ l • <? = I, (9-45) 

which means that the matrix for G~ l is obtained by inverting the matrix for G . 

The COFACTOR tensor 

In direct notation [see Ref 21], the cofactor tensor G c is defined by 

G c • (« x v) = (G • u) x (G • v) for all vectors u and v (9.46) 
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This definition might seem quite strange until you think about it physically. Recalling 
Fig. 5.2, the cross product u x y is perpendicular to the plane spanned by u and y and its 
magnitude equals the area of the parallelogram formed by u and y . Suppose that all vec- 
tors are now transformed by a linear operator G . Then the vector u becomes G • u and y 
becomes G • v. Thus, the vector on the right-hand-side of Eq. (9.46) is the new area vec- 
tor formed by the transformed vectors. Though not at all obvious, it turns out that this new 
area vector is linearly related to the old area vector hxv. Since the relationship between 
the old and new areas is linear, Eq. (9.7) tells us there must exist a tensor, which we denote 
G c , that can act on the old area to give the new area. 

In direct notation, Eq. (9.46) is written 

G fj( e jkm U k V m) = e irs( G rk U k)( G sm V m) ( 9 - 47 ) 

or, since this must hold for all u k and v m , 

GfcjkJ = H-sG rk G sm . (9.48) 

Multiplying both sides by s km and using Eq. (3.87) shows that 

2G pj = £ irs G rk G nn £ pkm ( 9 - 49 ) 

or, rearranging and changing the symbols used for the free indices, 



G ij 2 G ipq G pr G qs G rsj 



(9.50) 



In direct notation, 



G c = ]-G:H:G. 

2 s i * ' 



where H is a sixth-order tensor* whose components are given by 



ijmnpr imp jnr V-^.a ) 

Writing out Eq. (9.50) explicitly reveals that the component matrix associated with the 
cofactor tensor equals the cofactor of the component matrix for [G] (see Eq. 3.94): 

[G C ] = [G] c (9.52) 



Clearly, the teaching benefit of putting as many under-tildes beneath a tensor as the order of the ten- 
sor is reaching the point of comically diminishing returns — typesetting them is hard for the writer 
and counting them is hard for the reader. 
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Incidentally, the transpose of the cofactor tensor is often called the "adjugate" tensor. 
Unfortunately, some writers also call this the "adjoint," but this is a dangerous misnomer 
(perhaps originating from mis-hearing the word "adjugate"). When applied to tensors, the 
term "adjoint" should be defined to mean the complex conjugate of the transpose — at 
least that's how it should be defined if you want your lexicon to agree with that of mathe- 
maticians. Of course, if the components are real the adjoint is just the transpose, and it is 
not the same as the adjugate. We use the term "cofactor" to side-step the whole ugly issue. 

Examination of Eq. (9.50) reveals that the cofactor of the transpose equals the trans- 
pose of the cofactor. In other words, these two operations commute, and you can write 
qcr = ( g c ) t = (G T ) C = G TC . 

The cofactor tensor G c is well defined even if G is non-invertible. However, if G 
happens to be invertible, then 

G c = det(G) G T (9.53) 

Incidentally, if we define A Q = u x y to be an "initial" area vector and if we define 
A = (G • u)x(G •v) to be the "transformed" area vector, then substituting Eq. (9.53) 
into Eq. (9.46) gives 

A = det((r) G~ T »A o (9.54) 

In continuum mechanics, this equation is known as Nanson's formula. 
For the record, the result of differentiating G c with respect to G is 

8GC 

-y^ £ irm^ T mn £ njs (9.55) 

Axial tensors (tensor associated with a cross-product) 

Consider the cross-product, a x x . If the vector a is regarded as fixed, then the cross 
product may be regarded as a vector-to-vector transformation f(x) = a x x . This trans- 
formation is linear because, for any scalars a and p and any vectors u and y, 
f(a.u + Py) = af(u) + P/(y) . Consequently, recalling Eq. (9.7), we can assert that there 
must exist a tensor A such that f(x) = A • x . In other words, we seek a tensor A such 
that 

a xx = A • x (9.56) 

Writing this out in component form gives 

z ijk a j x k = A ik x k ( 9 - 57 ) 

We used the symbol "&" as the dummy summation symbol on the right hand side so that 
the subscript on x there would be the same as on the left-hand-side. Asserting that this 
equation must hold for all x k gives the formula for the tensor: 

A ik = Zijk a j ( 9 - 58 ) 

Equivalently, 
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(9.59) 



By moving the summed index to abutting locations, we can write this result in direct 
(structured) notation as 



A=- s • a 



(9.60) 



Note that the tensor A depends on a , but is independent of x . We can regard this result 
itself as a definition of a vector-to-tensor operation that transforms the vector a into a ten- 
sor A . Below, we emphasize that A is given by an operation on a by using the symbol 
Q <a> instead of the symbol A . 

Given any vector a, you can always construct a skew-symmetric "axial tensor" 
defined by 



Q <fl> = 



s • a 



(9.61) 



The components of the axial tensor are given by 



Q <a> 



Equivalently, 



"y 



- £ ijk a k 



s ikj a k 



(9.62) 



(9.63) 



Expanding out the implied summation over the index k (noting that all terms for which 
i=j are zero), the matrix for the axial tensor is related to the components of the vector a 
according to 



[£TH 







Wo t*n 



C/n C* i 



(9.64) 



For any vector x , note that 



iXn iX"\ 



-a 2 a x 







a 3 X l _a l x 3 
(X i JC "\ CX"\X,\ 



(9.65) 



The components on the right-hand-side of this equation are components of the cross prod- 
uct a x x . Stated in direct notation, 



Q<a> 

Similarly, 

Q<a> 



(9.66) 



(9.67) 
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These results show that axial tensors can be used to convert a cross product into a dot 
product between a tensor and a vector. The axial tensor associated with a vector can be 
regarded as simply an alternative way to represent a vector, and this formulation is conve- 
nient in any expression involving cross products. 

Glide plane expressions. The mathematical description of any problem that deals 
with material shearing on a plane frequently ends up involving dyadic expressions of the 
form be- cb . We have not yet defined what a dyad or a dyadic means. For now, regard 
this particular dyadic as a special skew symmetric tensor (the alternating tensor), and its 
associated axial vector is the cross product between b and c . That is, 

^•(bxc) = bc-cb, (9.68) 

where, for a right-handed orthonormal basis, L, ijk = & ijk (the permutation symbol). We 
placed this result here because of its intimate connection with cross products. Expressions 
like this show up frequently in single crystal plasticity theory. 

Axial vectors 

Given any tensor B , the associated axial vector can be constructed by 

co <5> = - - s:B (9.69) 

In component form, this notation means 

Expanding out the summations over i and /* shows that 



1 



°>1 = 2 (5 32" 5 23) ( 971 ) 

»| 5> = ^13- 5 3l) ( 972 ) 



1 

2 ( 



^t B> = ^ B 2l- B ll) ( 9 - 73 ) 



Note that 



co <5> = co <skw5> (9.74) 

In other words, the axial vector is determined entirely from the skew-symmetric part of a 
tensor. The symmetric part has no influence. 
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Cofactor tensor associated with a vector 

The cofactor operation is really meant to be applied to an even-order tensor (second- 
order, fourth-order, etc.)- Consider, however, the most general form for a skew-symmetric 
tensor W . To be skew-symmetric, this tensor must satisfy 



W- 



-W- 



from which it follows that W n 



W, 



22 



W: 



33' 



w, 



12 



-w. 



21 ' 



w. 



23 



-w. 



32' 



(9.75) 
and 



W._ 



31 



-Wy, • As will be discussed later, it is common practice to associate a vector w 



with a skew-symmetric tensor, defined such that w x 



■W. 



23' 



Wn 



-W 3l , and 



us 



-W l2 ■ In terms of this vector, the most general form for the 3x3 matrix of a skew- 



symmetric tensor is 



m 



(9.76) 



Taking the cofactor of this tensor gives 



[f c ] 



V 2 W \ 



v V v x 



T2 



vyv 2 



ViW-y 



v 2 rv 3 



(9.77) 



Referring to Eq. (7.38), we recognize that this matrix is simply the matrix associated with 
the dyad ww . Therefore 



If w is the axial vector associated with a skew-symmetric tensor W , then 
W c = ww 



(9.78) 



In many computational analysis codes, skew-symmetric tensors are not saved as 3x3 
matrices (doing so would be a waste of valuable memory). Instead, when a subroutine 
requests a skew-symmetric tensor from the host code, it will instead be given the three 
components of the axial vector w . If that routine needs to compute the cofactor of the full 
skew-symmetric tensor W, then it must recognize that all it needs to do is construct the 
dyad ww . 

Cramer's rule for the inverse 

The inverse may be expressed in terms of the cofactor tensor as 
g ct 



G l = 



det(G) 



(9.79) 



Cramer's rule is very inefficient for computing the inverse of a large matrix, but it is per- 
fectly adequate for the 3x3 matrices associated with second-order tensors in 3D space. 
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Inverse of a rank-1 modification (Sherman-Morrison formula) 

In general, there is no direct notation formula for the inverse of the sum of two matri- 
ces. But there is a simple formula for any rank-1 modification of a tensor. Specifically, if 



B = A + vw. 



(or, in indicial form, B { - = A-- + v-w) (9.80) 



then (as readily verified by back substitution) 



B 



-l - 



A 1 • vw • A 1 

1 + w • A~ l • v 



H 



A~ x v w A~^\ 

A-\ _ im m n nj 
1] 1 -W A~ l V j 

p pi r 



(9.81) 



One disadvantage of the Sherman-Morrison formula as cited above is that it presumes 
that the tensor A is invertible. However, A does not necessarily need to be invertible itself 
in order for the expression A + vw to be invertible. For example, it might be that 
[A] = DIAG[0, 1,1], which~is not invertible. But if {v} = {w} = {1,0,0}, then 
[A + vw] will equal DIAG[ 1, 1,1], which is invertible. To generalize the Sherman-Mor- 
rison formula to be able to handle cases like this, what we really need are separate formu- 
las for the determinant and cofactor of A + vw . These formulas are 



det[4 + y»y] = det(4) +A c :vw 



(9.82) 



and 



B c = A c -vxA xw (9.83) 

Here vxAxw is a second-order tensor with // components s, mn S;„ t ,vA n w^. Rather 

"" sj "" J - 1 I HI It J i & III Hi s 

than using this formula directly, it is easiest to evaluate this tensor by 



vxAxw = Q <v> • A • Q <w> . 



(9.84) 



where Q and Q 
tively (see page 



are the axial tensors associated with the vectors v and w respec- 



Derivative of a determinant 

Let J denote the determinant of a tensor F : 
J=detF 



(9.85) 



Recall that the determinant of a tensor can be obtained by simply taking the determinant 
of the matrix of components associated with that tensor: 



J=det 



^11 ^12 ^13 

F 2l F 22 F 23 

•^31 F32 -^33 



(9.86) 



135 
Copyright is reserved. Individual copies may be made for personal use. No part of this document may be reproduced for profit. 



September 4, 2003 5:24 pm 
Tensor analysis primitives 



From this we see that J = J(F n , ...,F 33 ). In other words, J is a function of the nine 
components of F . Now we seek to know the partial derivative of J with respect to any 
one of the components F- holding the other components fixed. Recall from simple matrix 
analysis that the determinant in Eq. (9.86) can be computed using cofactors: 



J 



y f.f c - 



(no implied sum on i ) 



(9.87) 



Now recall that the cofactor Ff. is the signed determinate of the submatrix obtained by 
striking out the z th row and / th column of [F] . Consequently, this striking out of rows and 
columns at the ij position implies that Ffj does not depend on the value of F i ■ , and the 
derivative of Eq. (9.87) gives simply 



8J 

dF U 



= F S 



(9.88) 



In direct notation, this result is written as, 



— = JF~ 
dF 



dJ _ pc 
dF 



or, if F is invertible, 



(9.89) 



Exploiting operator invariance with "preferred" bases 

GOAL: 

An important technique in tensor analysis uses invariance of tensor operations to jus- 
tify performing proofs in the context of a cleverly chosen or otherwise convenient basis. 
Whenever working with a symmetric matrix, for example, a particularly convenient basis 
is the principal basis for which the component matrix becomes diagonal. If A is symmet- 
ric, then 



14] 



a \ 











a 2 











a 3_ 



with respect to the principal basis for A 



(9.90) 



Other tensors will not generate diagonal matrices with respect to the principal basis for A . 
If, however, the matrix for a different tensor happens to be diagonal with respect to the 
principal basis for A , then you can immediately assert that the eigenvectors for that matrix 
coincide with those for A . Knowing that composition (i.e. the dot product) between two 
tensors corresponds to matrix multiplication and knowing that composition is an invariant 
operation, you can perform matrix multiplications within any convenient basis, and then 
recast the result back to invariant (structured/direct/Gibbs) notation when you are done, 
and, as long as all of the operations that you performed in the matrix context corre- 
sponded to tensor invariant operations, you will be justified that the final structure nota- 
tion result will be correct when cast in terms of some different basis. 
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A sometimes useful generalization of Eq. (9.90) that applies to a non-symmetric tensor 
F follows from our knowledge that any tensor can be decomposed uniquely into the sum 
of a symmetric tensor A = \(F + F T ) plus a skew-symmetric tensor B = \{F - F T ) . 

F = A+B (9.91) 

Being symmetric, we know there exists a basis (the principal basis for A ) such that the 
matrix for A is diagonal as in Eq. (9.90). We also know that any skew-symmetric basis 
will have a matrix expressible in the form of Eq. (9 .76) for any basis. Thus, knowing that 
tensor addition, which is an invariant operation, can be cast as matrix addition, we can 
assert that there will always exist an orthonormal basis (namely the principal basis for A ) 
such that its components for any generally non-symmetric tensor F will be of the form 



[F] 



a x -b 3 b 2 
b 3 a 2 -b x 
-b 2 b x a 3 



with respect to the principal basis for symF (9.92) 



Here, the a k are the eigenvalues of symF and the b k are the components of the axial vec- 
tor for skwF with respect to this principal basis. 

By using this special matrix representation, some proofs become much easier. Sup- 
pose, for example, that we wish to find a formula for the invariants of F expressed in 
terms of scalar invariants of A = symF and B = skwF . We know that scalar invariants 
can be computed by taking the matrix invariants of the RCS matrix for F . Being invariant, 
we know that the result we obtain using one basis will be identical to the result obtained 
using any other basis, so why not use the convenient basis in Eq. (9.92). Taking the trace 
of Eq. (9.92) gives 

I 2 (F) = a 2 a 3 + b\ + a 3 a x + b 2 + a x a 2 + b\ 

= a 2 a 3 + a 3 a x + a x a 2 + b\ + b 2 + b\ (9.93) 

Recognizing the first three terms to be the second invariant of A and recognizing the last 
three terms to be the square magnitude of the axial vector associated with B , and knowing 
that both the second invariant and vector magnitudes are invariants, we can now cast this 
result in a structured direct notation that applies to any basis (even though we derived in a 
special basis): 

I 2 (F) = I 2 (A) + b»b (9.94) 

Preferred bases are not limited to principal bases. You might, for example, want to set up a 
basis that is aligned with a structural component of interest. Your vectors and tensors 
might not have particularly simplified components in this basis, but other reasons might 
make the choice nonetheless convenient. 
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"Human salvation lies in the hands of 
the creatively maladjusted. ' 
— Martin Luther King, Jr. 



10. Projectors in tensor notation 

Nonlinear projections do not have a tensor representation 

A projection transformation P(x) (regardless of whether it is linear or nonlinear) will 
have a range space and a family of level sets. Given a vector y in the range space, the 
associated level set is the set of all vectors x for which P(x) = y . In other words, the 
level set is the collection of vectors that will all project to the exact same result. Level sets 
associated with two different y vectors will not intersect. 

A rank-m projection is one whose range space is m-dimensional, and, for projections 
in general TV-dimensional space, the level sets will then be N— m dimensional. Nonlinear 
projections will have a curvilinear range space and/or at least one curvilinear level set. 

Consider, for example, the following nonlinear projec- 
tion: 

P(X) = i( x *fi) + (x»n) 2 -x»x]n (10.1) 

where n is a specified (known) unit vector. The expression 
in the brackets is a scalar, so this equation says that P(x) is 
a scalar times the vector n * Thus, the range space is a 
straight line in space; the line passes through the origin 
because P( 0) = . Knowing that the zero vector happens 
to belong to the range space, what is the level set associated 
with the zero vector? The answer is the set of all x for 
which P(x) = , or the set of all x for which 

x»n = x»x-(x»n) 2 (10.2) 

To get a better handle on the geometrical description of this 

level set, let's set up a coordinate system for which e 3 = n . Then the component form for 

Eq. (10.2) becomes 




* Knowing that P(x) will be of the form an for some scalar a , you can readily verify that P is 
indeed a projector because P(an) = an , or P(P(x)) = P(x) . 
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x 3 = xf+xf (10.3) 

This is the equation for a paraboloid centered about n . The level set associated with a dif- 
ferent member of the range space, an , will be a paraboloid of the same size and shape, 
but passing through an . The inset figure shows the level sets for the vectors , n , and 
2n in the range space. All points on a given paraboloid will project to the same point in 
the range space. 

For this example, the range space is 1 -dimensional (the line parallel to n ) and the level 
sets are each 2-dimensional (paraboloids). The sum of these dimensions equals the dimen- 
sion of space (three). For this example, the range space was linear, but the level sets were 
curvilinear. 

The signum function is a different projection operator for which the range space is 
two-dimensional (the curvilinear surface of a unit sphere) and the level sets are 1 -dimen- 
sional (lines emanating radially from the origin). For projections in three dimensions, the 
dimensions of the range and level set spaces will always sum to three. For nonlinear pro- 
jections, either the range and/or the level set space will be curvilinear. 

Recall that tensors characterize only linear operators. Consequently, a nonlinear pro- 
jection P(x) cannot be fully characterized by a tensor that is independent of x . 

Linear orthogonal projectors expressed in terms of dyads 

For any linear vector-to-vector function f(x), recall that linearity guarantees that 
f(0) = 0. Hence, the zero vector must be a member of the range space for any linear 
function. Moreover, the range space for any linear operator must be a linear manifold. A 
linear manifold is a set of vectors for which any linear combination of vectors in that man- 
ifold will result in a vector that is also in the manifold. The surface of the unit sphere (i.e., 
the set of all unit vectors) is an example of a 2D space that is not a linear manifold because 
a linear combination of unit vectors is not itself generally a unit vector. In ordinary (New- 
tonian) 3D space, a linear manifold is typically a line or a plane that passes through the 
origin. The entirety of this 3D space is also be a (degenerate) linear manifold because any 
linear combination of 3D vectors is itself a 3D vector. The zero vector is a degenerate 
zero-dimensional linear manifold because any linear combination of zero vectors is itself 
the zero vector. For any linear function f(x) , recall that the Representation Theorem of 
Eq. (9.7) guarantees the existence of a tensor F that is independent of x for which 
f(x) = F • x . Our goal now is to apply this fact to the special case of linear projection 
operators. 

Linear projections will always have both linear range spaces and affine level sets. In 
three dimensions, an affine space is simply line or a plane that possibly does not pass 
through the origin. The range space for a rank-1 linear projection will be a ID straight line 
passing through the origin and the level sets will be families of parallel 2D planes that 
intersect the line. The range space for a rank-2 linear projection will be a plane passing 
through the origin and the level sets will be a family of parallel straight lines that intersect 
the plane (think of these level sets as the "light rays" that cast the shadow of a vector onto 
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the plane). For oblique linear projections, the range space will not be perpendicular to the 
level sets. The level set dimension will be complementary to that of the range space (if the 
range is a line, the level set will be a plane, and vice versa). Except for degenerate projec- 
tions (the zero or identity operator), the level sets will be families of parallel lines or paral- 
lel planes; of these, exactly one will pass through the origin and will therefore be a linear 
manifold. This special level set will be called the null space for the projection operator. 
Because the null space is the level set corresponding to the zero vector, it must be the set 
of all vectors x for which P(x) = . 

A linear projection function must, according to Eq. (9.7) submit to a tensorial repre- 
sentation. The tensor will be non-symmetric for oblique projections and symmetric for 
orthogonal (nearest point) projections. In Fig. 6.3, the range space is the plane whose nor- 
mal is b and the projection direction is in the direction of a . For an orthogonal projection, 
a is proportional to b and, referring to Eq. (6.12), the projection transformation can be 
written 



Q(x) = x- n(n • x) 
Applying the definition of a dyad, this can be written 

Q(x) = Q»x 



(10.4) 



(10.5) 



where 



Q 



nn 



(10.6) 



This is the projection tensor (or projector) associated with the linear projection operator 
in Eq. (10.4). The operator Q(x) is a rank-2 projection because its range space is two 
dimensional, and we show below that the matrix rank of [Q] is also two. The complemen- 
tary rank-1 orthogonal null projection of Eq. (6.65) can now be written 



P(x) = P»x, 



(10.7) 



where 



? = l-Q 



nn 



(10.8) 



Being a rank-1 projection, the matrix rank of [P] is also 1. If we set up a basis for which 
e, = n , then [recalling Eq. (9.24)], 



Q 



~\~\ + ~2~2 



<^ 



[Q] 



1 o o 

1 




w.r.t. e 3 =n 



(10.9) 



a ~3?3 



O 



[?] 





1 



w.r.t. e 3 =n 



(10.10) 
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When expressed in the preferred (aligned) basis, each projector is like "a piece of the iden- 
tity tensor." This makes a lot of sense. If a vector x is already in the range space for a pro- 
jector P , then P • x = x, so the projector is the identity operator within the range space. 
If, on the other hand, a vector x is in the null space for a projector P , then P • x = . 

Just one esoteric application of projectors 

GOAL: Give an illustration of a physical problem whose governing equations are improved 
through the use of projectors. 

Suppose, that it is known that most of the vectors and tensors of interest in a physical 
problem have some intimate symmetry connection to a plane of normal n . Then it makes 
sense to set up a basis that is aligned with this plane in order to search for simplifications 
in the equations governing the phenomenon. This is done, for example, when shock phys- 
icists state that the jump in the "shear" components of the deformation gradient tensor 
must be zero, and they phrase this requirement mathematically by stating that, with 
respect to a basis having the 3 -direction parallel to the shock normal n , the jump in the 
deformation gradient tensor components must satisfy 

[[^cJ] = ' wnere * ranges from 1 to 3, and a ranges from 1 to 2 (10.11) 

Where the double brackets denote the jump (value behind the shock minus value ahead; 
i.e., [[( )]] = ( ) behind - ( )ahead) Since the index a is allowed to range only from 1 to 
2, the above equation is stating that 

[[|j] * Q = <?, where Q = I-nn (10.12) 

or, simply, 

[[f]] = [[£]]•*« (10.13) 

This direct notation form of the same result is far more useful because (1) it does not 
require setting up a basis aligned with the shock front, (2) it permits taking time rates that 
allow the orientation of the shock front itself to changing with time and/or space, and (3) it 
lends itself nicely to extended, more complicated, analysis of the jump across intersecting 
shock fronts. 



IMPORTANT: Finding a projection to a desired target space 

Sometimes the projection function P is not known in advance. Instead, only the 
desired range space is known. Referring to Eq. (10.9a), note that P is merely the sum of 
dyads of an orthonormal basis for the range space. In general, if a range space is known, 
all one has to do is obtain an orthonormal basis for the range space and sum the diagonal 
basis dyads to obtain the projector. This concept is fairly trivial in ordinary 3D space, but 
it becomes more subtle and extremely useful in advanced materials modeling, which deal 
with nine- or six-dimensional vector spaces (spaces of class Vg or VI ). Keep in mind that 
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Q is also a projector. Its associated range space in this example is simply the 3-axis. The 
alcove statement also applies to constructing Q . In summary, if you have a collection of 
vectors { v 1? v 2 , . . . } , and you wish to construct the orthogonal (nearest point, high noon) 
projector to the space or subspace spanned by them, then you must first use Gram-Schmidt 
orthogonalization to generate an orthonormal basis {n k } where k ranges from 1 to the 
dimension of the space. Then the associated projector is 

p = 2>*s* ( 10 - 14 ) 

k 

If, for example, you seek the projector to the one-dimensional space spanned by a single 
vector v , then the projector to the line parallel to v would be 

v ® v 
p = v±il, (10 .15) 

V • V 

where we have inserted the dyadic multiplication symbol for clarity. If you have two vec- 
tors, u and v , that are already orthogonal, but not necessarily normalized, then the projec- 
tor to the plane containing u and v will be 

p= u®u + v®v^ (1Q16) 

~ U • U V • V 

As discussed in great length on page 237, a subset of vector space is called a subspace 
if every linear combination of members of the set is itself in that set. For vectors in 3D, 
subspaces are boring (either lines, planes, or the space itself). However, subspaces in 
higher dimensions are rich with information. Later on, for example, we will show that 
engineering second-order tensors are themselves nine-dimensional vectors. The set of all 
isotropic tensors is a subspace because any linear combination of isotropic tensors is itself 
isotropic. Therefore, there must exist a. fourth-order projection tensor that will transform 
any tensor T into its isotropic part. Later on, we will show that any isotropic tensor (in 
3D) must be expressible in the form of a scalar multiplied by the identity tensor /. There- 
fore, the identity tensor itself forms a basis for the set of all isotropic tensors. In analogy to 
Eq. (10.15), the associated fourth-order projection operator is given by 

I®I 

p = - (10.17) 

I /;/ 

where ":" denotes the inner product for second-order tensors, defined later. The ijkl com- 
ponents of this projector turn out to be 38^8^ . The complementary projector is an opera- 
tor that returns the part of a tensor that is "perpendicular" to its isotropic part — in other 
words, it gives the deviatoric part. 

For every subspace, a corresponding projector can and should be constructed so that 
the projection theorem can be invoked. The more complicated and higher dimensional the 
space, the more useful this concept becomes. 
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Properties of complementary projection tensors 

Consider a projection transformation P(x) and its complement Q(x) as defined in 
Eq. (6.66). If the function P is linear, then so is Q , and they therefore have associated ten- 
sors II and . For linear projectors, Eqs. (6.67) may be written 

n«n = n 0*0 = 

n«© = 0«n = 
n + = / 

x p »x Q = x»U T »Q»x (10.18) 

For example, the projection tensor associated with Eq. (6.66) is 

= I-- - (10.19) 

~ * (? *k 

or, using the "no-symbol" dyadic notation, 

© = /__2L (10 .20) 

The complementary projector is 

n = -^- (10.21) 

The general properties listed in Eq. (10.18) can be readily verified to hold for this particu- 
lar example. 

Self-adjoint (orthogonal) projectors 

A projection operator P(x) is "self-adjoint" if and only if y • P(x) = x • P(y) for all 
vectors x and y . If the projection is linear, this means that its associated tensor P must be 
symmetric: 

A projection P is self-adjoint (orthogonal) if and only if P T = P . 

Therefore, Q T = Q also holds. (10.22) 

For example, we see that the projector in Eq. (10.21) is self adjoint if and only if 
qb = bq. Recalling Eq. (7.31), this is possible only if b = aq , in which case the projec- 
tion reduces to the orthogonal projection of Eq. (6.12) in which the unit vector n is just 

a/||fl|| . 

A linear self-adjoint projector transforms its argument to the nearest point on the range 
space. This means that the null space is orthogonal to the range space. For ordinary projec- 
tions in 3D-space, this means that the vector is projected orthogonally, not obliquely. 
When Eq. (10.22) holds, the last property listed in Eq. (10.18) becomes 
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x p »xQ = q (io.23) 

Suppose that two distinct vectors x and y are decomposed via the projection theorem as 
* = x p + xQ 

y = y p+ y Q (10.24) 

Then their inner product is given by 

x»y = x p •yf + xQ*y p + x p •yQ + xQ^yQ (10.25) 

If the projection is self-adjoint, then any vector in Q-space must be perpendicular to any 
vector in P-space. Thus, the middle two inner products in the above equation are both 
zero, and we obtain 

x»y = x p »y p + xQ»yQ (10.26) 

Equivalently, 

x»y = x»P»y+x» Q»y (10.27) 

which could have been deduced more quickly by simply dotting the relationship 
P + Q = I cited in Eq. (10.18) from the left by x and from the right by y . 

Non-self-adjoint (oblique) projectors 

GOAL: Call out some differences between orthogonal and oblique projectors 

WARNING TO THE READER: I am in the middle of a 
notation change so that different symbols will be used 
for the projectors when they are non-self-adjoint. In this 
section, the tensors n and mean the same thing as p 
and q. This notation change has not yet propagated 
everywhere in this document, so you will have to decide 
from context whether or not a projector is self-adjoint 

Even for oblique projections, the relationship IT + = / still holds and therefore 

x»y = x»U »y + x» »y (10.28) 

As was the case for self-adjoint projectors, we can still define parts of a vector 

x(P) = u»x andx(2) = @*x (10.29) 

For oblique projections, the projectors are not symmetric. We can define dual projections 
by 

x = Il T »x and* = @ T • x (10.30) 

Similar breakdown of the vector y can be performed, and it turns out that 

*•$ = * (P) • y {P) + * (fi) • y (Q) (io-3i) 
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Note the distinction between this result and Eq. (10.26). 



Generalized complementary projectors 

Given a projector P , its complement is also a projector defined by Q = I— P. Sup- 
pose that the range space associated with one of these projectors has a dimension greater 
than one. Then that projector may always be further decomposed into more projectors, all 
of which may be made complementary to each other. For second-order tensors referenced 
to ordinary 3D space, there can be up to three projectors P , P , and P . For second- 
order tensors referenced to N -dimensional space, there can be a total of M orthogonal 
projections, where M<N. These generalized complementary projectors must satisfy 

P.* P. = P., where i is a free index (no summation) 
P • P. = if i* j 



M 



Z p k = l 



(10.32) 



k= 1 



The dimension of the range space for each projector is given by 



dimP. = rank[P] = trP. 



(10.33) 



If all of the projectors are self-adjoint (i.e., if they are all symmetric) then dimP. may 
alternatively be computed by 



dimP. = P :P 



(10.34) 



where the double dot operation is defined such that, for any tensors A and B, 
A:B = AyBy (see Eq. 3.60). For self-adjoint (symmetric) projectors, the generalization 
ofEq. (10.27) is 



f M \ 



x • y = x • 



E 



(10.35) 



V*=l J 



For example, the projector P Eq. (10.9) represents a projection to the 12 plane. This pro- 
jection can be decomposed further into more primitive projectors; namely e l e l and e 2 e 2 . 
Hence, if desired, we could define a set of three generalized mutually orthogonal comple- 
mentary projectors as 



SiSi 



[?] 



1 





(10.36) 
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?2?2 



s3 ~3?3 



<=> 



[« 



[f 3 ] 



For this example, Eq. (10.35) becomes simply 





1 







1 



(10.37) 



(10.38) 



x*y 



% • €l€l *y + * • ?2?2 



'J + X«e 3 e 3 «J 



(10.39) 



= x iyi +x 2 y 2 +x 3 y 3 , 

which is a comfortingly familiar formula! In the next section, we will define the eigen- 
problem and show how each distinct eigenvalue has a corresponding unique eigenprojec- 
tor. If a complete set of eigenvectors exist, then they may be combined as sums of dyads to 
generate a complementary projector set satisfying the properties of Eq. (10.32). If the 
original tensor is symmetric, then its eigentensors are also symmetric. 
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"If you live to the age of a hundred, you've got it 
made, because very few people die past the age 

of a hundred" — George Burns 
k / 

11. More Tensor primitives 

Tensor properties 

GOAL: List the properties that a person should look for in a tensor because numerous 
useful theorems exist for tensors with certain properties. 

In subsequent sections we will categorize tensors according to whether or not they 
have certain properties. For example, a tensor F is said to be symmetric if F-. = F- . It 
is skew-symmetric if F. = -F„. It is orthogonal if F ki F k - = 8- . It is a rotation if 
it is orthogonal and has a positive determinant. It is invertible if it has a nonzero determi- 
nate. It is a deformation if it has a positive determinant. It is a stretch if it is symmetric 
and has all positive eigenvalues. It is a commuter with a second tensor G if 
F • G = G • F . Investigating whether or not a tensor has any of these special properties 
is an essential activity because many tensors that occur in physical applications fall into 
these categories and therefore lend themselves to numerous special theorems that may 
help you in your analyses. These classifications of tensors are so important, in fact, that 
Gurtin [24] even gave them the following names: 

Lin = the set of all tensors 

Lin+ = the set of all deformation tensors 

Sym = the set of all symmetric tensors 

Skw = the set of all skew-symmetric tensors 

Psym = the set of all stretch tensors 

Orth = the set of all orthogonal tensors 

Orth+ = the set of all rotation tensors 

Of these, Lin, Sym, and Skw are linear manifolds of dimension 9, 6, and 3, respectively. A 
linear manifold is a set for which any linear combination of members of that set will itself 
be in the set. For example, a combination of symmetric tensors will itself be symmetric. 
Orth is not a linear manifold because a linear combination of orthogonal tensors will not 
be itself orthogonal. Incidentally, the dimensions of Lin, Sym, and Skw presume that the 
underlying physical space is three-dimensional so that general tensors contain 9 indepen- 
dent components, symmetric tensors have 6 independent components, and skew tensors 
have 3 independent components. In fact, Sym and Skw are perpendicular subspaces of Lin 
(by this we mean that any member of Sym is also a member of Lin, any member of Skw is 
also a member of Lin, and any member of Sym will have a zero inner product with any 
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member of Skw). Linear manifolds can be interpreted geometrically as hyperplanes that 
pass through the origin. Any linear combination of vectors in a plane through the origin 
will itself belong to the plane. For tensors, the term hyperplane is used to emphasize that 
the plane is more than three dimensional. 

Lin+, Orth, and Orth+ are not linear manifolds, but they are groups under multiplica- 
tion. A set of tensors is a group under multiplication if taking the dot product between 
two members of the set will result in a tensor that is itself a member of the set. For exam- 
ple, the product of two orthogonal tensors will itself be orthogonal. Groups can also be 
identified with hyper-geometries. However, because they are not linear manifolds, these 
geometries will be curvilinear spaces (in much the same way that the set of all unit vectors 
can be described geometrically as being the set of all points on the surface of a unit 
sphere). In some cases, a curvilinear tensor space can be assigned a dimension, which is 
determined by the nominal dimension of Lin (nine) minus the number of independent 
equality constraints that must be satisfied by the components. It can be shown, for exam- 
ple, that Orth+ is three dimensional because (being the set of all rotations) any member of 
Orth+ can be uniquely defined by specifying an angle of rotation (1 number) and a unit 
axis of rotation (two independent numbers, with the third component being constrained to 
generate a unit vector). Geometrically, Orth+ can be identified with a portion of a three- 
dimensional hypersphere. 

Now we are going to proceed with giving more detailed discussions of tensor proper- 
ties and their associated specialized theorems. 

Orthogonal (unitary*) tensors 

Consider a linear transformation f(x) in which the transformed vector always has the 
same length as the original vector. In other words, 

f(x)'f(x) =x*x (11.1) 

Since the transformation is linear, the Representation Theorem of Eq. (9.7) says there 
must exist a second-order tensor Q such that 

fix) = Q*x, (11.2) 

so Eq. (15.37) becomes 

((?•*) •((?•*) = x»x (11.3) 

or 

x*(Q T * Q -I)*x = (11.4) 



Typically, when dealing with real tensors, you will want to use the term "orthogonal." The word 
"unitary" is normally reserved for tensors or matrices that might have complex components. A 
matrix [Q] is unitary if [Q]~ l = [Q] H , where "H" is the hermitian (transpose of the conjugate). 
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This must hold for all x and (because the tensor in parentheses is symmetric), the above 
equation therefore implies that 



Q T *Ql= Q 



(11.5) 



Thus, the transpose of the tensor Q must equal its inverse. A tensor is said to be orthog- 
onal if its inverse is the same thing as its transpose: 



Q l = Q 1 



Q is orthogonal 



Equivalently, 

Q T *Q = Q*Q T = i 

By taking the determinant of this equation, we see that 
(detg) 2 = 1 



(11.6) 



(11.7) 



(11.8) 



The term "proper" is used if detQ = +1 and "improper" if detQ = -1 . These terms are 
unfortunate since they imply there is something unsavory about an orthogonal tensor 
whose determinant is negative. 

A proper orthogonal tensor corresponds to a rigid rotation about some axis, defined by 
a unit vector a , and, if we set up a basis in which the 3 -direction is aligned with the axis of 
rotation, then [7] 



[Q] 



cos a 


-sina 


sin a 


cos a 





1 



with respect to basis having e-, = a . 



(11.9) 



Here, a is the angle of rotation. This expression may be written 



[Q] 



cos a 



1 









0-10 


1 


+ 





+ sina 


1 







1 








with respect to basis where e 3 = a . 
Now we note that 



(11.10) 



[I-qq] 



and [««] 



1 

1 



with respect to basis having e 3 = 

where the tensor A is defined by A } 
expression for any rotation as 





1 



and [A ] 






-1 





1 














0_ 



a . 



(11.11) 



e Hk a k- Thus, we may write a direct notation 
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Q = cosa(/-«fl) + (««) + sina4 



(11.12) 



which is sometimes called the Euler-Rodrigues formula for a rotation. 

Many people wrongly claim that an "improper" orthogonal tensor corresponds physi- 
cally to a reflection, but it generally represents a reflection in combination with a rotation. 
In 3D, there are two types of simple reflections: (1) a reflection about the origin, which 
merely reverses the direction of all vectors without affecting their magnitudes, or (2) a 
"mirror-like" operation that will transform any vector x to become its mirror image across 
some plane defined by a unit normal n . The first type of reflection fully "inverts" space 
(east becomes west, north becomes south, and up becomes down). The second type of 
reflection inverts only one direction, leaving the others unchanged (left becomes right, but 
up does not turn into down). It's easy enough to guess the tensor that induces the first type 
of reflection; namely, if every vector "turns around", then the associated tensor must sim- 
ply be the negative of the identity tensor, Q = -I. For the second type of reflection, the 
part of the vector x in the direction of the "mirror" unit normal n is given by nn • x ; the 
reflection changes the sign of this part of the vector x to become -nn • x . However, the 
projection of the vector onto the plane of the mirror, x- nn • x remains unchanged. Thus, 
the reflection is given by the sum of this unchanged part plus the reversed part to give 



f(x) = x-2(nn • x) 
The corresponding reflection tensor is 



(11.13) 



Q = l~2nn 



(11.14) 



or 



[Q] 



1 





1 








-1 



with respect to basis where e 3 = n . 



(11.15) 



In 3D, that this "second-type" of reflection can always be regarded as a 180° rotation 
about n in combination with a "type-one" reflection about the origin: 



-10 


-10 


0-10 


0-10 


-1 


1 



[Q] 



with respect to basis where e-, = n 



(11.16) 



Note that the last matrix in this equation is identical to the matrix in Eq. (11.9) with the 
rotation angle a set to 180° . This is just one special case of a more general statement. 
Namely, in 3D, if Q is an improper orthogonal tensor, then Q = -R , where R is proper 
orthogonal. 
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Tensor associated with the cross product 

Using the permutation symbol, the component formulas for the cross product in a right- 
handed orthonormal basis given in Eq. (5.29) can be written compactly as 

(« x *) ; - = s ijk a j b k ( 11 - 17 ) 

Note that the operation, a x b is linear with respect to b . Hence, the Representation Theo- 
rem of Eq. (9.7) says there must exist a tensor A that is independent of b such that 

8x6 = 4 • b (11.18) 

The z th component of A • b is 

(A •b) = A ii b i (11.19) 

For Eq. (11.18) to hold, the right hand sides of Eqs. (11.17) and (11.19) must be equal: 

A ij b j = £ ijk a j b k (11-20) 

This relationship must hold for all b . Before we can eliminate b , however, we must 
change the dummy summation subscripts so that the indices on the b 's are the same on 
both sides of the above equation. We have b- on the left hand side of the equation. Conse- 
quently, on the right hand side of the equation, we must change the dummy subscript k to 
/' . Doing that, however, would result in four instances of /' , which would violate the sum- 
mation conventions. Hence, in order to change k to / , we must change / to something 
else. An easy way to do this is to change k to / and /' to k. Hence, Eq. (11.20) is equiva- 
lent to 



A ij b j = B «M (1121) 

that 
fore 



Now that both b 's have the same index, we may assert that this holds for all b- and there 



A ij = z-ikfk = -Zijk a k, ( 11 - 22 ) 

Let's quickly re-derive this result in an alternative manner by using Eq. (9.18). Specifi- 
cally, we know that A jn is the derivative of the z' th component of a x b with respect to b n . 
We arbitrarily selected the index symbol n because it is not already being used as an index 
anywhere in Eq. (11.17). Applying Eq. (9.18) gives the in component of A : 

d(a x b) i d(s ii]r a,b,) db. 

In the last step, we have used the fact that neither s ■ ^ nor a- depends on b . To simplify 
this result, we apply Eq. (9.18) to write db k /db n = 8 kn so that 

A in = *ijlPfikn ( 11 -24) 

or, applying Eq. (4.43), 

A in = & ijn^ ( 11 -25) 
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The index n is a free index, so we could change n to k, thereby demonstrating that 
Eq. (11.25) equivalent to the earlier result of Eq. (11.22). 

Now, we wish to write Eq. (11.22) in direct notation. Noting that s-, ■ = -s i : k , Eq. 
(11 .22) may be written 

A ij = -ZijkVk ( 11 -26) 

In direct notation, this result is written 

A = -§•« (11.27) 

In matrix form, the components of A are 



Wl = 



—a, a 2 
a 3 — Oj 
-«2 " j 



(11.28) 



which (incidentally) is equivalent to the tensor A in Eq. (11.11). Whenever a relationship 
of the form in Eq. (11 .27) holds, we say that a is the axial vector associated with the skew 
symmetric tensor A . 

By the way, observe that 

bxq =-(qxb) = -A • b = -b»A T (11.29) 

However, we see from Eq. (11 .28) that the tensor A has the skew-symmetry property that 
A T = -A (11.30) 

Therefore, Eq. (11.29) becomes 



b x a = b • A 



(11.31) 



Cross-products in left-handed and general bases. The formula in Eq. (11.17) 
applies only when the basis is orthonormal and right-handed. We seek here to present the 
generalized formula for the cross product that applies to some different (not necessarily 
orthogonal or right-handed) basis {#,,£,, if 3 } • When using a non-orthogonal or non- 
right-handed basis, standard notational conventions alter the summation rules to allow for 
two kinds of indices: a superscripted "contravariant" index and a subscripted "covariant" 
index and implied summations must always occur on different levels so that, for example, 
the basis expansion of the vector a is written 

a = a l g. (11.32) 

Since the three vectors, {g,,g 2 , g 3 } form a basis, we know that the a 1 coefficients exist, 
and you can refer to Ref. [6] for instructions on how to compute them. That reference also 
explains that there is no difference between super- and sub-scripted quantities when the 
basis is orthonormal. Hence, in the following equations, the orthonormal right-handed 
basis {gj, g 2 , e 3 } is the same as {g 1 , e 2 , g 3 } . 
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A more general version of the cross-product formula is 

(axA). = ^i* (11.33) 

where h, ijk are components of a third order tensor whose basis expansion with respect to 
an orthonormal right-handed basis is 

"% = z ijk e i eJe k (11.34) 

We have the basis expansion of t, with respect to our familiar and comfortable orthonor- 
mal right-handed basis, and we can obtain the components of h, with respect to the irregu- 
lar basis through the following formula ~ 

Zijk = a i Pa i ga i r£ pqr> 

where a " = e • e" (11.35) 

Though not immediately obvious, you can show that £,-.£ can be computed by the triple 
scalar product of the base vectors: 

5.yjfc = \*e*f*J < 11 - 36 ) 

Specializing this formula to an orthonormal but left-handed basis gives 

For an orthonormal basis, there is no difference between a' and a i . Likewise, b' = b r 
Hence, for an orthonormal left-handed basis, Eq. (11.33) becomes 

(« x k)i = - £ ijk a j b k ( 11 - 38 ) 

Comparing this with Eq. (11.17), it might appear that the cross product changes sign for a 
left-handed basis, but it doesn't. The vector components in Eq. (11.17) are different from 
those in Eq. (11.38) by a sign change. The negative in Eq. (11.38) compensates for this 
sign change so that the final resulting vector, 

flxft = (ax b) j e j (11.39) 

will be the same regardless of the handedness of the basis. The direct notation formula for 
the axial vector in Eq. (11.27) likewise does not change — direct notation formulas apply 
for any basis (how you compute the components varies, but the sum of components times 
base vectors is invariant). Note that we have denoted the tensor 2, using a symbol that dif- 
fers from the symbol for its right-handed RCS components, e^f This notational choice is 
also why we denote the RCS components of the identity tensor / by 5 ■ instead of /■ . 
Unlike the permutation tensor, the identity tensor components remain equal to 8 •• even for 
a left-handed orthonormal basis, but they are not 8- for a non-orthonormal basis. 
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Physical application of axial vectors 

The operation of Eq. (11.27) occurs quite frequently in 
mechanics. Suppose, for example, that r is the vector 
from the origin to a point P in a rigid body. If the rigid 
body rotates about the origin with an angular velocity 
vector co , then the velocity of the point P is given by 



co x r 



(11.40) 



Equation (11.18) implies that this relationship may be 
written alternatively in terms of an angular velocity ten- 
sor Q . Namely, 




rigid body 



Q«r. 



(11.41) 



where 



£t 



jot 



e 



to 



[Q] 



-co 3 co 2 



(0: 



-to, 



-C0 2 t ! 



(11.42) 



The usefulness of Q. instead of co becomes apparent by considering rotation. Rotation can 
be defined in termsof an axis and an angle of rotation, but multiple rotations about differ- 
ent axes do not commute (i.e., if you rotate about one axis and then about the other, the 
result will not be the same if you switch the order of rotation). Rotation can nevertheless 
be shown to be a linear transformation. In other words, given a collection of vectors, you 
can rotate them all individually and then take a linear combination of the results or you 
c^n first take the same linear combination of starting vectors and then rotate the result — 
either way, the final answer will be the same. Hence, the Representation Theorem of 
Eq. (9.7) says there exists a tensor R such that rotating an initial vector r o to obtain a new 
vector r can be written 



R*r 



(11.43) 



If the rotation varies in time, we can take time rates of this equation to obtain the velocity, 
v = r. Specifically, noting that the initial vector r is (obviously) not a function of time, 
the rate of Eq. (11.43) gives 



V ~ = R ' r ~o 

Noting from Eq. (11.43) that r o = R~ l • r, Eq. (11.44) may be written 

v = Q. • r , where Q. = R • I? -1 

* 
It can be shown that a rigid rotation tensor must be orthogonal and hence 

R- 1 = R T 



(11.44) 



(11.45) 



(11.46) 
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It can be shown [7] that this property in turn implies that Q must be skew symmetric. The 
associated axial vector is the angular velocity vector co . 

Symmetric and skew-symmetric tensors 

Note that the components in Eq. (11.28) have the following property: 

A u = —A {i or, in direct notation, A = -A T (11.47) 

Any tensor with this property is said to be "skew-symmetric." Here, the superscript "77' 
denotes the "transpose". 

A tensor A is "symmetric" if and only if it has the property that 

■A a = A h - or, in direct notation, A = A T (11.48) 

Let A be any second-order tensor, neither symmetric nor skew symmetric in general. The 
symmetric part of A is defined 

symA = -(A+A T ) (11.49) 

the skew-symmetric (or antisymmetric) part of A is defined 

skwA = -(A-A T ) (11.50) 

With these definitions, we see that any tensor A can be decomposed additively into sym- 
metric and skew-symmetric parts: 

A = symA + skwA (11.51) 

Instead of "sym" and "skw," many authors use superscripts "s" and "a" so that Eq. (11.51) 
would be written somewhat more compactly as 

A = A s +A a (11.52) 

Note that the act of taking the symmetric part of a tensor may be itself regarded as a tensor 
function: 

P(A) = \{A+4 T ) (11.53) 

This operation is a projection because P(P(A)) = P(A) . In other words, the symmetric 
part of a symmetric tensor is just the tensor itself. We can also define a function for taking 
the skew-symmetric part of a tensor: 

Q(A) = \(A-A T ) (11.54) 



* For a detailed discussion of orthogonal tensors, including the definition of Euler angles, and how to 
generate a rotation from an axis and angle, see Ref [7]. 
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The functions P and Q have the properties listed in Eqs. (6.67) except that, this time, the 
argument of functions is a tensor rather than a vector. Hence, the fact that any tensor can 
be split into symmetric and skew-symmetric parts is merely a generalized application of 
the projection theorem! 

Positive definite tensors 

A tensor B is positive definite if and only if 

x • B • x > for all vectors x (11 .55) 

This equation can be alternatively written as 

B:xx > for all vectors x , (11 .56) 

where ":" denotes the tensor inner product, soon to be defined in Eq. (12.1). Noting that 
the dyad xx is a symmetric tensor, we can use the (yet to be presented) result of Eq. 
(12.26) to note that B:xx = (symB):xx . Therefore, a tensor B is positive definite if and 
only if syml? is positive definite. The skew-symmetric part of B has no influence on pos- 
itive definiteness. Consequently, when assessing definiteness of a tensor, you should 
always immediately start working with the symmetric part of that tensor, 

A = symB (11.57) 

The tensor A (and therefore B ) is positive definite if and only if its associated component 
matrix is positive definite. This will happen if and only if all three characteristic invari- 
ants* of A are positive. WARNING: It is possible to construct a tensor B that has all pos- 
itive invariants, but the tensor is not positive definite. It is imperative to test the invariants 
of the symmetric part of B to check for definiteness. 

Faster way to check for positive definiteness. Recall from Eqs. (3.130) that 
the £ th characteristic invariant of A is given by the sum of principal k x k minors. It turns 
out that computing all of these principal minors is not necessary in order to test for posi- 
tive definiteness. All you have to do is test one principal minor of each size, making sure 
that, as you progress in size, the smaller principal minors are nested inside each larger 
minor. The concept of nesting makes more sense if we explain it starting with the largest 
principal minor, which is the determinant of the 3x3 matrix itself. For the next principal 
minor, select any 2x2 submatrix whose diagonal components are also diagonal compo- 
nents of the larger matrix, and verify that the determinant of this 2x2 submatrix is posi- 
tive. Then test the determinant of any lxl submatrix on the diagonal of the 2x2 matrix 
(i.e., check any diagonal component of that matrix). The following sequence of decreasing 
sized submatrices are all principal submatrices, but they are not nested: 



See Eqs. (3.130) on page 46. 
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A n A n A n 

Not nested: a 21 a 22 a 23 

^31 ^32 ^33 



^11 ^12 
^21 ^22 



. [^33] 



(11.58) 



These are not nested because the lxl submatrix [A 33 ] is not a submatrix of the larger 
2x2 matrix. Of course, in practice, now that the meaning of "nesting" is clear, it is wiser 
to check the determinants of the submatrices starting with the smallest one first. If, at any 
point in this process, you find a negative determinant, then you can stop calculations with 
the conclusion that the original matrix is not positive definite. 

Using the simplest nested set of principal minors (those that progress in size starting 
from the 1 1 position), the simplest test for positive definiteness of a 3 x 3 matrix involves 
merely verifying the following 



A n >0 



(11.59) 



det 



A n A n 
A 21 A 22 



>0 



(11.60) 



det 



^11 ^12 ^13 
^21 ^22 ^23 
^31 ^32 ^33 



>0 



(11.61) 



Recalling that you may use any set of nested principal minors, it follows that a positive 
definite tensor will always have positive diagonal components, so this is a good thing to 
visually check before even looking at the larger determinants. There is nothing, that disal- 
lows the off-diagonals from being negative, so long as the principal minors always evalu- 
ate to a positive number. 

Positive se/n/-definite 

A tensor B is positive semi-definite if and only if 

x • B • x > for all vectors x (11 .62) 

This means that the invariants (and nested subminors) will all be positive or zero. 

Negative definite and negative semi-definite tensors 

A tensor C is negative definite if -C is positive definite. Note that this means that the 
odd invariants I x and 7 3 must be negative, but the even invariant I 2 must be positive. * 



* The reason why odd invariants must be negative and even invariants follows from Eq. (3.99) in 
which the scalar multiple needed to check if -C is positive definite is (X= — 1 , making a^ in 
Eq. (3.99) equal to —1 if jV is odd, but +1 if TV is even. 
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from which it follows that its invariants (or principal subminors) will all be simply non- 
negative (i.e., positive or zero). A tensor C is negative se/n/-definite if —C is positive 
semz'-definite. 

Isotropic and deviatoric tensors 

Another operation that looks similar to (but is functionally different from) the sym+skw 
operation is one that decomposes a tensor into its deviatoric and isotropic parts. The devi- 
atoric part of A is denoted variously as A or A or A' or devA , and it is defined 

dev 1 

A = A' = A - -(trA)I (11.63) 

Here, tr4 is a scalar called the "trace" of A defined 

*4= A kk = A U +A 22 +A 33 ( 11 - 64 ) 

iso 

The isotropic part of A is denoted A or iso4 , and is defined 

iso 1 

A =-(trA)I (11.65) 

Thus, just as a tensor can be decomposed into symmetric and skew-symmetric parts, it can 
also be decomposed into deviatoric and isotropic parts: 

dev iso 

a=a +4 (11.66) 

This is also an application of the projection theorem! This equation is analogous to Eq. 
(11.52). 
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"Nothing pains some people more than having 
to think. " — Martin Luther King, Jr. 



12. Tensor operations 

Second-order tensor inner product 

The inner product (also called the double dot product) between two second-order 
tensors, A and B , is a scalar denoted A :B and defined 

Alternatively, this binary operation can be written 

A:B = tx{A T »B) = tr(A • B T ) (12.2) 

Beware: the notation A:B is not universally defined the same way by all people. Some 
people define the ": " operator to mean A mn B nm instead of A mn B mn . These are both legit- 
imate scalar-valued operations, and they give identical results if either A or B happens to 
be symmetric. However, for general (possibly non-symmetric) operands, only the defini- 
tion A mn B mn in Eq. (12.1) is an inner-product. The other operation, A mn B nm , is well- 
defined, but it is not an inner product. As noted in Table 1 . 1 on page 12, some authors [24] 
use the structure A • B to denote the inner product, which seriously conflicts with our 
structure A • B which means the tensor composition (an entirely different operation). 
Those authors tend to denote tensor composition by AB (i.e., A jk B k -) whereas, in our 
notational system the similar-looking structure AB would denote dyadic tensor multipli- 
cation resulting in a fourth-order tensor (with components A tj B kl ). We shamelessly 
believe that, in this case, our notational conventions are superior because they are self- 
defining and generalize seamlessly to higher dimensions [see the discussion on page ] . 

Our definition of A:B , in Eq. (12.1) is a summation of every component of A multi- 
plied by the corresponding component of B . Consequently, the tensor inner product is 
analogous to the ordinary dot product between vectors in ordinary physical space (see Eq. 
3.60). This is no coincidence. Applying a mathematician's definition of a vector 
(page 230), the set of all second-order tensors can be shown to be an abstract nine-dimen- 
sional vector space. In this space, the tensor inner product serves a role exactly like the 
vector dot product in 3D physical space. We can define the magnitude of a tensor and the 
"angle" between two tensors in a manner that is completely analogous to the definitions 
for ordinary vectors! 

An important special case of Eq. (12.1) is the inner product between two dyads: 
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ab:rs = a m b n r m s n = (a • r)(b • s) (12.3) 

An even more specialized instance of this formula applies it to the tensor inner product of 
basis dyads: 

SiSj-'SkSi = (Si • S*)(S/ • S/) = Sit 5 // ( 12 - 4 ) 

The double dot product is defined such that it must operate between tensors of at least 
second-order. There is no need for parentheses in Eq. (12.3) because b:r would be mean- 
ingless — the double dot is understood to "reach out" until it is acting between two tensors 
(in this case, qb and rs). Thus, for example, qbc:T would be interpreted as the vector q 
multiplied by the inner product of be with the second-order tensor T . The indicial expres- 
sion of this operation would be 

ab c T (12.5) 

i m n mn \"—"J 

Note, for future use, that 

u • A • v = A:uv (12.6) 

A NON-recommended scalar-valued product 

GOAL: Explain why a commonly used alternative scalar-valued product should be avoided. 

Note that only one single tensor in Eq. (12.2) has a transpose operation on it. That equa- 
tion therefore might appear to have an unsavory asymmetrical quality. A different double- 
dot product, which we will here denote by using two horizontal raised dots, is often 
defined in the literature as* 

A»B=A mn B nm = tr(A»B) (12.7) 

» a mn nm v » s ' v ' 

With this definition, the special case of the horizontal double dot of two dyads would be 
(qb)**(rs) = a i br-s i = (q • s)(b • r) . The scalar-valued operation in Eq. (12.7) does 
have an aesthetically appealing symmetry to its definition, and it is a perfectly legitimate 
operation. However, this scalar valued product must never be referred to as an "inner 
product." The operation A:B in Eq. (12.2) is an inner product, but the operation A»»B in 
Eq. (12.7) is not an inner product. 

We first mentioned our tensor inner product A:B in the context of matrix analysis (see 
Eq. 3.60), where it was subsequently shown that the operation could be used to define ten- 
sor magnitudes because A: A is always real and never negative. By contrast, the horizon- 
tal double-dot product A»»B does not satisfy the positivity requirement, so it must never 



The actual notation (structure) used for this operation varies. What's important here is the operation 
itself, not the notation used for it. It's not uncommon for writers to define the " : " and " • ■ " opera- 
tors oppositely from our definitions. 
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be referred to as an inner product. Both scalar-valued products, A:B and A**B , will give 
the same result if either of the operand tensors is symmetric. Hence, the distinction 
between them comes when neither of the operands are symmetric. A counterexample 
showing that the horizontal double-dot fails positivity is 



[4] = 10 (12.8) 






-1 





1 


















For this tensor, 

A:A = 2>0 (12.9) 

but 

A»»A = -2<0 (fails positivity test) (12.10) 

Incidentally, the ".* " operator is also the one that arises naturally in tensor calculus. If 
s is some scalar function of the components of A , then 

s = s(A n ,A n , ...,A 33 ) (12.11) 

If each component of A varies with time t , then the chain rule can be used to take the time 
rate of s : 

ds __ ds "A n ds dA l2 ds "^33 

dt dA n dt dA l2 dt '" dA 33 dt 

ds 3s 

Letting — - denote the tensor whose components are t— — , this result is written 
dA dA t . 

ds ds dA 

- = ini-r ( 12 - 13 ) 

dt dA dt 

The ".*" operator, not "•• ", appears naturally in the chain rule; each component of one 
tensor is multiplied by the corresponding component of the other tensor. 

Fourth-order tensor inner product 

The inner product between two fourth-order tensors, X and Y, is a scalar denoted 
X:: Y and defined 

f'[ B VtfH (1Z14) 

This is a summation of every component of X multiplied by the corresponding component 
of Y. Consequently, the fourth-order tensor inner product is analogous to the inner prod- 
ucts that we have defined for vectors and second-order tensors. Again, this is no coinci- 
dence. By applying a mathematician's definition of a vector, the set of all fourth-order 
tensors can be shown to be an abstract 81 -dimensional vector space. Although this view is 
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occasionally useful in applications, we will usually find that fourth-order tensors are most 
conveniently regarded as operations (such as material constitutive laws) that transform 
second-order tensors to second-order tensors. Hence, fourth-order tensors may be 
regarded as second-order tensors referenced to nine-dimensional tensor space. 

Fourth-order Sherman-Morrison formula 

When regarding second-order tensors as nine-dimensional vectors, the inner product is the 
tensor inner product (i.e., the double-dot product). Many formulas that were derived for 
ordinary 3D vectors have generalizations to this higher-dimensional space. For example, a 
rank-one modification of a fourth-order tensor is defined by a formula similar in structure 
to Eq. (9.80). The fourth-order inverse is given by a formula similar to that in Eq. (9.81). 
Namely, 



If B = A + VW 



(B 



ijkl 



4/H +F W 



(12.15) 



then 



B 1 = A 



A- l :VW:A~ l 



\ + W:A~ l :V 



D ijkl A ijkl 



a-\ y w a-\ 

ijmn mn rs rskl 

1 + W A~ l V 
" pq-^pqtu r tu < 



(12.16) 



Structurally, this fourth-order formula is identical to the second-order formula except that 
the vector inner products (single dot) are replaced with tensor inner products (double dot). 
This formula is frequently used in plasticity theory. 
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Higher-order tensor inner product 

Notationally, we have defined all of our inner products such that the number of "dots" 
indicates the number of contracted indices. Clearly, this notation is not practical for 
higher-order tensors. An alternative notation for an n th -order inner product may be 
defined as the order n surrounded by a circle. Thus, for example, 

X(4)Y means the same thing as X:: Y (12.17) 

Some writers [e.g., Ref 18 ] prefer always using a single raised dot to denote all inner- 
products, regardless of the order. These writers demand that meaning of the single-dot 
operator must be inferred by the tensorial order of the arguments. The reader is further 
expected to infer the tensorial order of the arguments from the context of the discussion 
since most writers do not indicate tensor order by the number of under-tildes. These writ- 
ers tend to define the multiplication of two tensors written side by side (with no multipli- 
cation symbol between them) to be the tensor composition. For example, when they write 
AB between two tensors that have been identified as second-order, then they mean what 
we would write as A • B . When they write UV between two tensors that have been iden- 
tified as fourth-order, they mean what we would write as U:V. Such notational conven- 
tions are undeniably easier to typeset, and they work fine whenever one restricts attention 
to the small set of conventional tensor operations normally seen in trivial applications. 
However, more exotic advanced tensor operations become difficult to define under this 
system. A consistent self-defining system such as the one used in this book is far more 
convenient and flexible. 



Self-defining notation 

Throughout this book, our notation is self-defining in the sense that the meaning of an 
expression can always be ascertained by expanding all arguments in basis form, as dis- 
cussed on page 128. The following list shows several indicial expressions along with their 
direct notation expressions under our notation 

U V U::V 

mnpq mnpq i * 



We call attention to this reference not because it is the only example, but because it a continuum 
mechanics textbook that is in common use today and may therefore be familiar to a larger audience. 
This notation draws from older classic references [e.g., 24]. Older should not always be taken to 
mean inferior, but we believe that, in this case, the older tensor notation is needlessly flawed. Our 
notation demands that a different symbol be used for each different inner product for each differ- 
ently ordered tensor space, whereas the older style overloads the same symbol to mean different 
inner products — operator overloading can be extremely useful in many situations, but we feel it 
does more harm than good in this case because it precludes self-defining notation. 
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ijkp plmn g g 

U-,,V uv 

ijkt mnpq m m 

A Pq u Pqi j 4--u 

A 'P U Pjki 4 • u 

AijU k i mn AU 

A ip*pJ* U *Um ~4»f (12-18) 

Writers who use inconsistent non-self-defining notational structures would be hard- 
pressed to come up with easily remembered direct notations for all of the above opera- 
tions. Their only recourse would be to meekly argue that such operations would never be 
needed in real applications anyway Before we come off sounding too pompous, we 
acknowledge that there exist indicial expressions that do not translate elegantly into our 
system. For example, the equation 

^j/jt/SiS/SjfcS/ = U ikjlZgjUZl ( 12 - 19 ) 

would have to be written under our notational system as 

A = X\(U) (12.20) 

where the rather non-intuitive swap operator X\ is defined in Eq. (19.44). Of course, older 
notation systems have no commonly recognized direct notation for this operation either. 
This particular operation occurs so frequently that we (later) introduce a new "leafing" 
operator to denote it by A = U L as an alternative to Eq. (12.20). Even when using the 
notational scheme that we advocate, writers should always provide indicial expressions to 
clarify their notations, especially when the operations are rather unusual. 

The difficulties with direct notation might seem to suggest that perhaps indicial nota- 
tion would be the best choice. In some instances, this is true. However, even indicial nota- 
tion has its pitfalls, principally in regard to operator precedence. For example, the notation 

—*— (12.21) 



is ambiguous. It could mean 

* In this equation, the negative appears because the cross-product is defined such that the summed 
indices on the alternating symbol must be adjacent (making them adjacent involves a negative per- 
mutation of £ ■ to make it —£,•„_ . 

PJ H JP H 



164 

Copyright is reserved. Individual copies may be made for personal use. No part of this document may be reproduced for profit. 



September 4, 2003 5:24 pm 
Tensor operations 



d f 

- — or tr 



9(tra) 






(12.22) 



The two operations give different results. Furthermore, we have already seen that the 
book-keeping needed to satisfy the summation conventions is tedious, error-prone, often 
limited to Cartesian components, distracting from general physical interpretations, and (in 
some cases) not well-suited to calculus manipulations. Nonetheless, there are certainly 
many instances where indicial notation is the most lucid way to go. 

Bottom line: in your own work, use the notation you prefer, but in published and pre- 
sented work, always employ notation that seems most likely to accomplish the desired 
interpretation by an educated reader. Your goal is to convince them of the truth of a scien- 
tific principle, not to intimidate, condescend, or baffle them with your (or our) whacked 
out notations (that we, of course, regard as brilliant and self-evident <g>). 

The magnitude of a tensor or a vector 

The magnitude of a second-order tensor A is a scalar denoted \\A II defined 



A\\ = A: A (12.23) 



This definition has exactly the same form as the more familiar definition of the magni- 
tude of a simple vector v: 



||v|| = Jv» v (12.24) 

Though rarely needed, the magnitude of a fourth-order tensor X is a scalar defined 



= •¥••••* (12.25) 



A vector is zero if and only if its magnitude is zero. Likewise, a tensor is zero if and only 
if its magnitude is zero. 

Useful inner product identities 

The symmetry and deviator decompositions of tensors are often used in conjunction 
with the following identities: 

A:B = sym4:sym J B + skw4:skw J B (12.26) 

A:B = dev^.-devfi + iso^.-isol? (12.27) 

Decomposition of the tensors into its symmetric plus skew symmetric parts 
(A = symA + skwA and B = syml? + skwB ) represents an orthogonal projection 
decomposition that is completely analogous to Eq. (10.24). Thus, Eq. (12.26) is a specific 
application of Eq. (10.26) in which tensors are interpreted in their V\ sense. A similar 
statement holds for the decomposition of tensors into deviatoric plus isotropic parts. 
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If B happens to be a symmetric tensor {i.e., if skwfi = 0) then the inner product 
between B any other tensor A will depend only on the symmetric part of A . Conse- 
quently, sometimes researchers will replace A by its symmetric part without any loss in 
generality — which can save on storage in numerical computations, but is unwise if there 
is any chance that A will need to be used in any other context. 

Incidentally, note that the "trace" operation defined in Eq. (11.64) can be written as an 
inner product inner product with the identity tensor: 



\xA=I:A 



Also note that /;/ = tr/ = 3 , so Eq. (12.27) may be alternatively written 



A:B = A':B' + htrA)(trB) 



(12.28) 



(12.29) 



Distinction between an N -order tensor and an N -rank 
tensor 

Many authors use the term "A* -rank tensor" to mean what we would call an "TV* -order 
tensor". We don't adopt this practice because the term "rank" has a specific meaning in 
matrix analysis that applies equally well for tensor analysis. The "rank" of a second-order 
tensor is here defined to equal the rank of the tensor's Cartesian component matrix (i.e., 
the number of linearly independent rows or columns). That way, for example, when we 
speak of rank- 1 projectors, we are speaking of second-order tensors that have a matrix 
rank of 1. Of course, our practice of saying TV* -order tensors has its downside too 
because it can cause confusion when discussing tensor polynomials. 

When a second-order tensor is regarded as an operation that takes vectors to vectors, 
then the "rank" of the second-order tensor is the dimension of the range space. For exam- 
ple, if a second-order tensor projects a vector into its part in the direction of some fixed 
unit vector, then the result of that tensor operation will always be a vector that is a multiple 
of the unit vector. This range space is one-dimensional, so the rank of this second-order 
tensor is 1 . 

Based on well-known matrix theory, we note that a second-order tensor is invertible 
only if its rank is 3. We have already used the term rank in connection with projections. A 
rank-2 second-order projection is a tensor that projects vectors to a 2-dimensional space. 
The rank of the component matrix equals the rank of the projector. 
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Fourth-order oblique tensor projections 

Second-order tensors are themselves 9-dimensional abstract vectors of class V\ with 
": " denoting the inner product. Consequently, operations that are defined for ordinary 3D 
vectors have analogs for tensors. Recall that Eq. (6.17) gave the formula for the oblique 
projection of a vector x onto a plane perpendicular to a given vector b . The "light rays" 
defining the projection direction were parallel to the vector a . The analog of Eq. (6.17) for 
tensors is 

A(B:X) 

PCX) = X- - - - . (12.30) 

As for the projection in 3 -space, this operation represents a linear oblique projection in 
tensor space. The "surface" to which X is projected is orthogonal to B and the oblique 
projection direction is aligned with A . This projection function appears in the study of 
plasticity [8] in which a trial stress state is returned to the yield surface via a projection of 
this form. 

The fourth-order projection transformation can be readily verified to have the follow- 
ing properties: 

P(aX) = aP(X) for all scalars a . (12.31) 

P(X+Y) = P(X)+P(Y) for all X and Y. (12.32) 

P(P(X)) = P(X). (12.33) 

The first two properties simply indicate that the projection operation is linear. The last 
property says that projecting a tensor that has already been projected merely gives the ten- 
sor back unchanged. 

Finally, the analog of Eqs. (6.34) and (6.35) is the important identity that 

P(X) = P(Y) if and only if X = Y+ $A . (12.34) 

This identity is used, for example, to prove the validity of radial return algorithms in plas- 
ticity theory [8]. 

Leafing and palming operations 

GOAL: Introduce a simple, but obscure, higher-order tensor operation 

Consider a deck of cards. If there are an even number of cards, you can split the deck 
in half and (in principle) leaf the cards back together in a perfect shuffle. We would call 
this a leafing operation. If, for example, there were six cards in the deck initially ordered 
sequentially, then, after the leafing operation (perfect shuffle), they would be ordered 
142536. If the deck had only four cards, they would leaf into the ordering 1324. 

We will here define a similar operation that applies to any even order tensor. The struc- 
ture to indicate application of this leafing operation will be a superscript "L." Let 
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U = U-- e e e e (12.35) 

denote a fourth-order tensor. The "leaf of this tensor will be defined 

U L = U- ■ e e e e (12.36) 

Note that the leaf was obtained by a perfect shuffle of the indices on U t - . In purely indi- 
cial notation, we would write 

U^- = U- ■ (12.37) 

upi wq v ' 

Note that shuffling the indices is equivalent to shuffling the dyadic ordering of the base 
vectors. In other words, the equation 

U = U- e e e e (12.38) 

I ^ijpq~i~p~j~q v ' 

is equivalent to Eq. (12.36). Note that leafing a fourth-order tensor is equivalent to simply 
swapping the middle two indices. 

Derivative of a leafing operation: 

dU L - dU- ■ 

>JE± = <£1± = 8888=8888 (12 39^ 



The leaf of a sixth-order tensor with components U ijk would be 

ijkpqr ipjqkr v ' ' 



Now consider a different (screwy) way to shuffle a deck of cards. First the deck is split 
in half, but then the second half is reversed before shuffling. For example, a six-card deck, 
originally ordered 123456 would split into halves 123 and 456. After reversing the order 
of the second half, the halves would be 123 654, and then shuffling would give 162534. 
We will call the analog of this operation on tensor indices a "palming" operation and 
denote it with a superscript T (i.e., an upside down "L"). Then, for fourth- and sixth-order 
tensors, the palming operator would give 



Ujjkl = U m (12.41) 

ijkpqr = U nyqkp (12.42) 



ijkl iljk 

and 



168 

Copyright is reserved. Individual copies may be made for personal use. No part of this document may be reproduced for profit. 



September 4, 2003 5:24 pm 
Tensor operations 



The leafing and palming operations have been introduced simply because these types of 
index re-orderings occur frequently in higher-order analyses, and there is no straightfor- 
ward way to characterize them in existing direct structural notation. Using these new oper- 
ations, note that the e-5 identity can be written 

8«8 = (Il) L -(II) r (12.43) 

Here, // is a dyad so that (II).. = §,-,§„,„ and therefore (II) L . = §, m 8,„ and 

' »* J ~~ i/mH U mn ~*' limn lm J" 

Symmetric Leafing. Given a fourth-order tensor U- kl , a common operation in mate- 
rials modeling involves minor-symmetrizing the minor indices. Just as a tensor A u can be 



'./ 



symmetrized by - (^4 ■ ■ + A- t ) , a fourth-order tensor can be minor-symmetrized by 

Uf jk i = U mm = \(U ijkl + U JM + U m + U jilk ) (12.44) 

Here, we have employed a common indicial notation convention that pairs of indices in 
parentheses are to be expanded in a symmetric sum. 

Now consider the leafed tensor U\- kl = U ikjl . Even if the tensor U ijkl is minor-sym- 
metric, its leaf will not necessarily be minor symmetric. The symmetrized leaf is denoted 
with a superscript A and defined 

Ufa = %(H) = \(U ikjl +U kijl +U iklj +U kilj ) (12.45) 

Symmetrized leafs are extremely common in constitutive modeling (especially for anisot- 
ropy). 
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"The chief function of your body is to carry your 
brain around. " — Thomas Edison 

13. Coordinate/basis transformations 

Change of basis (and coordinate transformations) 

Quite frequently, people speak of coordinate transformations as if they were the same 
thing as basis transformations. They're not. The coordinates of a point in 3D space com- 
prise exactly three independent numbers. Each distinct set of coordinates uniquely identi- 
fies the location of the point in space. For example, cylindrical coordinates are {r, 9, z} . 
In the vast majority of applications, the base vectors are defined in a way that is coupled to 
the choice of coordinates. For example, the base vectors that are natural for use with cylin- 
drical coordinates are { e r , e Q , e z } , and these orthonormal vectors are defined to point in 
the direction of increasing values of the corresponding coordinate. The components of the 
position vector x are the coefficients of the vector when it is expanded as a linear combi- 
nation of the base vectors. For cylindrical coordinates, the position vector is given by 
x = re r + ze z ; note that there is no term in which the second base vector e Q appears. 
Therefore, even though x depends on three coordinates {r, 0, z} , it has only two nonzero 
components. Dependence of the position vector x on the angular coordinate is contained 
implicitly in the dependence of the radial base vector e , on 9 . For rectangular cartesian 
coordinates, referenced to the laboratory basis, it does so happen that the vector compo- 
nents are identical to the vector coordinates {x l ,x 2 ,x 3 }. 

As mentioned above, the choice of basis is almost always motivated by the choice of 
coordinates so that each base vector points in the direction of increasing values of the 
associated coordinate. However, there is no divine edict that demands that the base vectors 
must be coupled in any way to the coordinates. If, for example, you were studying the 
mechanics of a ferris wheel, then you might favor using cylindrical coordinates to identify 
points in space (with the z axis parallel to the wheel's axis, but the laboratory basis (with, 
say, e 2 perpendicular to the ground) to reference physical vectors such as the acceleration 
of gravity. Using the cylindrical base vectors, the acceleration of gravity would point 
along - ( sin9)g r - cos9g e , but using the lab basis, it is simply proportional to e 2 . In this 
section, we describe the effect of changing the basis. This discussion is, in principal, com- 
pletely unrelated to changing coordinates. 
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Consider two different orthonormal* triads: a reference (or laboratory) basis 
{E v e v e x } and a "tilde" basis {e p e 2 , e 3 } . A vector v can be expressed in terms of 
either basis as follows: 

v = Vjg-, where v- are the components of v w.r.t the e- basis (13.1) 

v = v t "e., where v t are the components of v w.r.t the e basis (13.2) 

Both expressions represent the same vector v . Thus, it must be true that 

VjSi = v t e t (13.3) 

The "hat" components {v l5 v 2 , v 3 } are not generally equal to the "tilde" components 
{vj, v 2 , v 3 } , but they are related in a very specific way. Specifically, if the two bases are 
not equal to each other, then the components with respect to each of these bases must also 
be different from each other. However, the components must change in response to a basis 
change in such a way that the sum of components times base vectors is invariant — either 
representation characterizes the same vector. 

Coordinate and basis transformations are awkward to explain, and everyone has their 
own way of doing it. Our Reference [7] provides detailed derivations of the procedure for 
the case of changing from one orthonormal basis {e,,e 2 ,e 3 } to another reoriented, but 
still orthonormal, basis {e x ,e 2 , g 3 } '• Coordinate transformation discussions always 
begin with the definition of a "direction cosine" matrix [Q] whose components are given 
by 



Q« = Ei-ej 



(13.4) 



This is called the direction cosine matrix because, applying Eq. (5.5), 



Qtj = cosQ tj , (13.5) 

where 9 ■ ■ is the angle between E. and e- . Thankfully, you don't have to find these angles 
to construct the [Q] matrix. Just find the components of each reoriented e base vector 
with respect to the reference e k basis. Then assemble these components into columns of 
the [Q] matrix so that the /* th column contains the tilde components of the e base vector. 
An example is provided at the end of this section. 

Some people define the direction cosine matrix alternatively by 

L^Ej'l = e i .E j (13.6) 

Note that Z,.. = Q jt therefore the results that we present below can be readily converted to 
this alternative definition by simply replacing all occurrences of [Q] by [L] T . 



* For a discussion of general non-orthonormal bases, see Ref. [6]. 

t In our Reference [7], the notation is different, but the meaning is the same. Specifically, Reference 
[7] uses E k to denote what we are calling e k . It uses g, to denote what we here call e k . It uses v k 
to denote what we are here calling v k . Tildes in Ref. [7], become "hats" in this document. The 
equations listed in this document have already been converted to the present notation. 
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Our Reference [7] provides proofs for the following key equations governing basis 
reorientation: 



[Q]- 1 = [Q] T 



(i.e., the direction cosine matrix is orthogonal) 



(13.7) 



If the handedness of both bases is the same, then det[g] = +1 . If the handedness of 
one basis is different from the other, then det[g] = -1 . 



€, = Q,,e 



ji~j 



I = QtA 



U~J 



(13.8) 



(13.9) 



For a vector v = v j e i = v-e- , the components are related by 



v j = Qu v . 



In matrix form, {v} = [£?] r {v} 



(13.10) 



~ v t = Qifj 



In matrix form, {v} = [Q]{v} (13.11) 

For a second-order tensor T = T { ~e~e. = T kl e k e l , the components are related by 

T k l = QikQjlTij, or in matrix form, [T] = [Q] T [f][Q] (13.12) 

h = QikQjihl, or in matrix form, [f] = [Q][T][Q] T (13.13) 

Higher order tensors transform similarly. For example, if £, is a third order tensor, then 

l nnr = QivQiaQkrlm ( 13 - 14 ) 

(13.15) 



^pqr ^ip^jq^kr^>ijk 

^ijk ^ip^jq^kr^pqr 



To remember these equations, just recognize that transforming an «-th order tensor 
requires the presence of n occurrences of Q . Furthermore, the first index on Q will always 
match the index on the "tilde" component while the second index on Q will always match 
the index on the hat component. 

For transformations within a plane (i.e., when only two base vectors change while the 
other two reorient in the plane), a graphical tool called Mohr's circle can be used. 
Although Mohr's circle is typically taught only for symmetric matrices, it generalizes eas- 
ily for non-symmetric matrices (see Ref [9]). 

For changing from one nonorthonormal basis to another, the transformation rules are 
considerably more complicated (see Ref [6]). 
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EXAMPLE. 

Most of the time, you know the components of one basis with respect to the other. In 
Fig. 13.1, for example, we show two differently aligned "tilde" and "hat" bases. 




Si = 5*1 + 5*2 



3~ ^4~ 



§3 f?3 



H = 5^1 + €2 




4~ 3~ 
5fii-5f 2 



3~ 4~ 



?3 ?3 



v = 1.24g 1 + 0.32g 2 



Figure 13.1. Relative basis orientations. In (a), a grid is set up to be aligned with the tilde basis 
(with dashed grid lines at intervals 1/5 of a unit apart), and the hat basis is expressed in terms of the 
grid (tilde) basis as shown. In (b), a grid is set up oppositely. Note that the vectors themselves are the 
same in parts (a) and (b) — only the orientation of the observer (as indicated by the grid) is different. 
The vector v is the same in both drawings, but it has different components with respect to the differ- 
ent bases. 



In Fig. 13.1(a), we set up a grid to be aligned with the "tilde" basis. Our goal is to 
change over to the "hat" basis. In particular, we would like to compute the components of 
the red vector, v , with respect to the "hat" basis. We could solve this problem graphically 
(and therefore approximately) by simply setting up a new grid [Fig. 13.1(b)] that is 
aligned with the "hat" basis and then just reading off the components of the red vector 
with respect to this new grid. To solve the problem exactly, we need to use transformation 
formulas. 
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The hat basis is expressed in terms of the "tilde" basis as shown in Fig. 13.1 (a/ By 
expressing the "hat" basis in terms of the "tilde" basis, we can compute the direction 
cosines. For example, 



2i2 €1 • €2 ~i 



3~ 4~^ 3 



(13.16) 



This would be the normal way that you would compute Q 12 . However, it can be done dif- 
ferently. In Fig. 13.1(b), we have a grid aligned with the "hat" basis, and the tilde basis is 
expressed in terms of the "hat" basis as shown. In this scenario, the calculation of Q l2 can 
be performed by 



Q12 = ii • € 2 



4~ 3^ - 3 

5?i-5§ 2 J-€2 = -5 



(13.17) 



Either approach produces the same result for Q l2 - Proceeding similarly to compute the 
other components of [Q] gives 



[Q] = 



4 


3 





5 


5 




3 


4 








I) 


b 


b 










1 



(13.18) 



Note that the columns of the [Q] matrix contain the tilde components of the hat base vec- 
tors. The rows of [Q] contain the hat components of the tilde basis. For this reason, the [Q] 
matrix is often presented in the form of a table that explicitly shows the base vectors. For 
this example, the direction cosine table would be written 

Direction cosine table 



4/5 


-3/5 





3/5 


4/5 











1 



Now consider the red vector v shown in Fig. 13.1. Let's suppose that we know how to 
express this vector with respect to the tilde basis. Namely, 



4~ ~ 
5*1 +*2 



(13.19) 



Therefore 
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4 

5' 



v 2 = 1 







(13.20) 



Our goal is to find the "hat" components of this vector. The direction cosine matrix for this 
example was already computed in Eq. (13.18). Substituting the transpose of this matrix 
into Eq. (13.10) gives us the result for the components of this vector with respect to the hat 
basis: 



or 



(13.21) 



„ 


4 


3 




T 


4 3 n 




" v ll 




5 


5 







4/5 




5 5° 


4/5' 




31/25 




1.24 


v 2 




3 


4 




■ 


1 


> = 


3 4 n 


< 1 


> = ■ 


8/25 


> — « 


0.32 


.^ 3 J 




5 


5 












15° 























1 




1 





1.24^ + 0.32*2 



(13.22) 



This result is consistent with the graphical estimate shown in Fig. 13.1. 



Definition of a vector and a tensor. Many authors use the vector transformation 
relation in Eq. (13.10) as a definition of the term "vector" for ordinary 3D physical space. 
They say that a vector is any set of three numbers that are defined with respect to a basis in 
such a way that the numbers change according to Eq. (13.11) upon a change of basis. In 
this document, we are more precise by saying that these three numbers are components of 
a vector. The vector itself is defined to be the sum of the components times the base vec- 
tors; this sum is invariant upon a change of basis. This definition of "vector" eliminates 
the ambiguity associated with the sloppy definition of a vector as "something with length 
and direction." 

On page 230, we explain that a mathematician will likely puff up proudly and define a 
vector to be a "member of a vector space." This pompous definition is not circular so long 
as the phrase "vector space" has already been defined. Specifically, as discussed on 
page 230, a vector space is a collection of objects that satisfy certain properties under 
addition and multiplication. The definition of a vector according to its transformation 
properties is merely a discerning criterion for identifying members of a particular candi- 
date collection of objects. To be mathematically justified in using our transformation defi- 
nition of a vector, we must follow through and test that vector addition and scalar 
multiplication do indeed satisfy the mathematician's required axioms (they are indeed sat- 
isfied). The mathematician's definition of a vector requires scalars (which they call mem- 
bers of a field) to be defined separately. Formally, a scalar is a zero-order tensor and a 
vector is a first-order tensor. 

Engineering texts typically define second-order tensors to be ordered 3x3 arrays of 
numbers referenced to a basis such that those numbers change according to Eq. (13.12) 
upon a change of basis. In this document, we call the numbers themselves the components 
of the tensor. We define the tensor itself to be the sum of components times basis dyads, 
which is invariant under a change of basis. 
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Basis coupling tensor. Recall that 

Qij = li*lj (13.23) 

We can always construct a basis-coupling tensor Q as 

Q = £*i* ( 13 -24) 

We may write 

Q = 8yg£j = S,jUj = Q,m = QiM (13.25) 

It follows that 

e k = Q'h (1 3 - 26 ) 

or, equivalently, 

I = Qj,ej = Qfc (13.27) 

We have not accidentally inserted a transpose in the last equation here. The basis coupling 
tensor is a linear transformation that operates on the tilde basis to produce the hat basis. 
The basis coupling tensor corresponds to a rigid rotation of space and all vectors in space. 
By contrast, the component transformations we have discussed in this chapter deal with 
holding space and all vectors fixed while we reorient the observer. You would use the 
basis coupling tensor if you wanted to transform material vectors so that they are aligned 
with the reoriented basis. 
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"When I'm working on a problem, I never think about beauty. 

I think only how to solve the problem. But, when I have 

finished, if the solution is not beautiful, I know it's wrong. " 



— Buckminster Fuller 



14. Tensor (and Tensor function) invariance 

This section may be skipped, but it does provide some useful insight into what is meant by 
a tensor. 

What's the difference between a matrix and a tensor? 

This is one of the most common questions for new students of tensor analysis. The 
answer comes down to the fact that tensor matrices must correspond to components with 
respect to an underlying basis, and the component matrix must change according to the 
tensor transformation rules of the previous section upon a change of basis. If this does not 
hold true, then the matrix is just a matrix, not a tensor component matrix. 

Suppose that a tensor is defined by giving a "rule" for constructing its components 
with respect to any convenient orfhonormal basis. We use the term "tensor invariance" 
to mean that the following: 

If you apply the "rule" in the two bases separately, then the two results must be related 
to each other by the transformation rule appropriate for the order of the result. 

Stated in a slightly different way, if you want to know the result of the "rule" in a second 
basis, you can do one of the following: 

• You can apply the rule in the first basis and then transform the result to the second 
basis. 

• You can first transform the arguments of the rule to the second basis, and then apply 
the rule directly in the second basis. 

Either way, you should obtain the same result. If you don't, then the "rule" violates tensor 
invariance. 

When we talk about tensor invariance or when we use the phrase "valid tensor rule," 
we are using the word tensor in its generalized sense for which scalars are regarded as 0- 
order tensors, vectors are 1 st order tensors, etc. Therefore, the above statements also apply 
for the question "What is the difference between a vector and a set of three numbers?'" 
Suppose your next door neighbor told you that (for whatever reason) he was working with 
a set of three numbers defined to be two times the index of the number. Then the first num- 
ber would be 2, the second 4, and the third 6. He would have an array of three numbers 
given by {2, 4, 6 } . To determine if your neighbor is actually working with a vector, you 
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would first have to ask him if the indices of his rule had anything to do with a particular 
set of directions. Since this tutorial limits its scope to orthonormal bases, we will presume 
that he told you that the three directions corresponded to east, north, and up (which are 
orthogonal). You would then ask your neighbor if his index doubling rule would still apply 
if he were to instead use three different orthogonal reference directions such as north-east, 
north-west, and up. If his answer is "yes, the doubling rule applies for any set of orthonor- 
mal reference directions" then you would conclude that he is merely working with an 
array of three numbers, not a vector. To prove that your neighbor's doubling rule does not 
correspond to a vector, you would only have to find one counter-example that violates the 
invariance criterion. Let {e v e 2 ,e 3 } denote the directions {east, north, up}. Now let 
{E v E 2 , E 3 } denote the directions {north-east, north-west, up}. In other words, let 

E l = ±- =2, E 2 = ~ l ~ 2 , E 3 = e 3 (14.1) 

Then, the doubling rule in this system would give a vector 

2E l + 4E 2 + 6E 3 (14.2) 

or 

-4e, + 6e~, 

— — + 6e, (14.3) 

72 ~ 3 

Thus, the doubling rule applied directly in the second system does not result in the same 
vector as would be obtained by applying that rule in the first system from the outset 
(namely, 2e l + 4e 2 + 6e 3 ), and you must therefore conclude that your neighbor's rule 
gives a well-defined array, but (alas) not a vector. 

Suppose, on the other hand, that your neighbor had told you that the doubling rule was 
never intended to apply in a different system. You would then have to ask him to provide 
you with a general rule that applies in any system. If the general rule has the property that 
you will end up with the same vector, no matter what system you use, then his general rule 
would correspond to a vector, not just an array. In general, if you have a rule that gives you 
three numbers v x , v 2 , v 3 with respect to {e v e 2 ,e 3 } and the definition of the rule is such 
that it gives you three different numbers V x , V 2 , V 3 when applied to any other orthonor- 
mal triad {E v E 2 , E 3 } , then the rule corresponds to a vector if and only if 

V l?l + v 2?2 + V 3?3 = ^1^1 + ^2-^2 + ^3-^3 (14.4) 

In other words, even though the components will generally vary upon a change of basis, 
the sum of components times base vectors does not change. That's why the term invari- 
ance is used. It says that a vector (the sum of components times basis) is invariant under a 
change of basis. If the basis changes, then the components must change in a fully compen- 
sating manner so that Eq. (14.4) remains true. For second-order tensors, a similar state- 
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ment applies. Namely, the set of nine basis dyads (gjgj, e x e 2 , <^ 1 <g 3 , e 2 e x , ..., e 3 e 3 ) forms 
a basis for second-order tensors. A set of nine numbers (a n ,a l2 ,a l3 ,a 2l , ...,a 33 ) corre- 
sponds to a second-order tensor if and only if the rule that assigns these numbers changes 
upon a change of basis in such a manner that 

ayetSj = A ijEiEj (14.5) 

where {E V E 2 ,E 3 } is any other (orthonormal) basis and {A n ,A l2 ,A l3 ,A 2l , ...,A 33 ) 
are the nine new numbers resulting from applying the rule in the new basis. If the above 
equation does not hold true, then the rule, and any numbers it spits out, do not correspond 
to a tensor. 

Thankfully, the triplets and ordered 3x3 arrays that pop up in physics typically do 
satisfy the vector and tensor invariance requirements of Eqs. (14.4) and (14.5). That's no 
surprise, since any physical phenomenon should be unaffected by the coordinate frame 
that we adopt to describe it. The components do not mean much by themselves, but the 
sum of components times bases (being invariant) does have strong physical significance. It 
is the sum that means something as a single entity. Even though describing a velocity 
requires supplying three numbers, you'll never hear a person say "the velocity are ... ". 
Being a vector, velocity is (and should be) regarded as a single entity. Physical phenomena 
are routinely described conceptually using direct notation. For particular problems, or in 
computer codes, component expressions are used. 

Whenever a "rule" is proved to satisfy invariance, we always endow it with a struc- 
tured direct (Gibbs) notation. Whenever a new operation is defined exclusively in terms of 
invariant operations, then the new operation is immediately known to be toe//"invariant. 



Any expression that can be written in direct notation 
is automatically known to be invariant itself. 



Example of a "scalar rule" that satisfies tensor invariance 

Given a vector v with components {v l5 v 2 , v 3 } with respect to a basis {e v e 2 , e 3 } , 
we propose constructing a scalar by applying the following "rule" 

s = v\ + v 2 +vl (14.6) 

or, using summation notation, 

s = v.v. (14.7) 

Now consider a second basis {e v e 2 , e 3 } . If we apply the "rule" directly in this second 
basis, we get 

s = v-v. (14.8) 

To demonstrate that the "rule" satisfies tensor invariance, we must demonstrate that 
Eqs. (14.7) and (14.8) give the same answer for the scalar s . Recalling Eq. (13.11) we 
know there exists an orthogonal matrix [Q] such that 
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Vj = v&j (14.9) 

Substituting this into Eq. (14.7), being extra careful to introduce two distinct dummy sum- 
mation indices, gives 

s = ~y m Q mi v k Q ki ( 14 - 1 °) 

Since [Q] is orthogonal, we know that Q mi Q ki = 8 mk . Hence 

S = ~ V m^mk V k = ~ V m V m ( 14 - 11 ) 

which is identical to Eq. (14.8). Thus, this "rule" for constructing the scalar s satisfies ten- 
sor invariance. Now that we know that this rule is invariant, we are permitted to give it a 
direct notation symbol. Of course, the symbol for this operation is already defined — it is 
simply the dot product: 

s = v • v (14.12) 

Example of a "scalar rule" that violates tensor invariance 

Scalars themselves are invariant under a coordinate transformation. Newcomers to ten- 
sor analysis therefore often jump to the conclusion that any "rule" that produces a real 
number must be invariant. This section shows why this is not the case. If you look back at 
our definition of an invariant rule, you will see that you must be able to apply the rule in 
any two coordinate systems, and the results must differ from each other by the transforma- 
tion between the systems. If the rule produces a scalar, then invariance demands that both 
systems must produce the same value for the scalar. 

Given a vector v with components {v l5 v 2 , v 3 } with respect to a basis {e v e 2 , g 3 } , 
let's consider the following "scalar-valued rule:" 

s = Vj +v 2 + v 3 , (14.13) 

In other words, the scalar is constructed by simply adding up the vector's components. To 
show that this rule is not invariant, all we need is a counterexample. Consider a vector 

v = 3£j+4i 2 (14.14) 

Consider a second basis 

1 ~ 1 „ 

€i = p(3? 1 + 4e 2 ), e 2 = -(-4e l + 3e 2 ), and e 3 = e 3 (14.15) 

In terms of this second basis, the vector v is just 

v = 5'e x (14.16) 

Now, if we apply the rule of Eq. (14.13) to Eq. (14.14) we obtain s = 1 . However, if we 
apply the rule to Eq. (14.16), we get s = 5 . The final results do not agree! Consequently, 
summation of the components of a vector is not an invariant operation. This is an interest- 
ing conclusion since we found in the previous section that summation of the squares of 
components is invariant. 
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Example of a 3x3 matrix that does not correspond to a tensor 

If you look up the definition of the term "tensor," many textbooks (especially older 
engineering books) will say that a tensor is a 3 x 3 matrix of components referenced to a 
basis such that the components will change in a particular manner upon a change of basis. 
Specifically, the components must change according to the basis transformation rule 
described Eq. (13.13). To help clarify this concept, let's present something that can be 
defined as a 3 x 3 matrix, but which is not the component matrix for any tensor. 

In rigid body dynamics, the moments of inertia of a body Q. describe the amount of 
resistance the body has against being rotated. For example, the moment of inertia \|/ zz is 
defined by 

v zz = \\\(* 2 +y 2 )pdv (14.17) 

n 

Here, {x, y, z} are the Cartesian coordinates of a point in the body. Thus, the quantity 
(x 2 + y 2 ) is the square of the distance of a point from the z axis. Intuitively, the farther 
points are from the z axis, the harder it is to rotate those points body about the z axis. 
Hence, \\i zz is a good measure of the resistance of the body to rotation about the z axis. 
The moments of inertia about the other two axes are defined similarly: 

v xx = \\\(y 2 +z 2 )pdV (14.18) 

n 



Vyy = \\\(z 2 +* Z )pdV (14.19) 

n 
The products of inertia are defined in many books by 

Vx, = \\\(xy)pdv, y yz - \\\{yz) P dv, and ¥zx = \\\(zx) P dv (14.20) 

no. a. 

Though less intuitive, these quantities measure how much "wobble" you would feel when 
rotating the body about an axis. 

It would seem natural to arrange these inertias into a 3 x 3 matrix as 



[V] 



Vxx Vxy 


Vxz 


Vy X Vyy 


Vyz 


Vzx Vzy 


Vzz_ 



(14.21) 



Here, we have defined \|/ =\|/ , etc. to construct a symmetric matrix. It is perfectly legit- 
imate for us to arrange the inertias into a matrix form. The question arises, however: 



QUESTION: Does the [ V F] matrix correspond to a tensor? 
ANSWER: No, it does not! 
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Whenever you wish to prove that something is false, all you need is a counterexample. 
Consider a body Q. that is a tiny ball of mass m located on the x axis at a distance L from 
the origin. Treating the ball as a point mass so that x»L,yxzxQ, the inertia values are 



V 



yy 



Vz 



mL 2 and all other \|/ » 



(14.22) 



Thus, 



[\|/] = mi/ 



w.r.t. the {xyz} coordinate system. 




1 
1 

Now consider a different "hat" coordinate 
system as shown. In this coordinate system, 
x = y^L/Jl and z«0. Applying the 
definitions of the inertia components in this 
hat system gives 



Vix = Vyy = 2 mLl 



(14.23) 



y 



V 2 



Vx 



= mL 1 



= -mL 1 




m 



L 



Thus, 



[v|/] = mL 2 



1/2 


1/2 


1/2 


1/2 





1 



w.r.t. the {xyz} coordinate system. 



(14.27) 



Now the question becomes: would we have obtained Eq. (14.27) if we had merely per- 
formed a coordinate transformation ofEq. (14.23)? Let's show that the answer is "no." 
The direction cosine matrix for the transformation from the {xyz} system to the {xyz} 
system is 



[Q] 



1 


1 





J2 


72 




1 


1 





72 72 










1 



(14.28) 



If we assume (incorrectly) that the [x\i] matrix corresponds to a tensor, then the following 
relationship should be true 



Mw., t . = IQ] T M W ,,.[Q] 

{xyz} {xyz} 

Thus, if [\|/] corresponds to a tensor,* then it should be true that 



(14.29) 
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1/2 1/2 

1/2 1/2 

1 





"-L i o 

72 72 





72 72 




72 72 


1 
1 


— 4=0 

72 72 




1 




1 



This equation is false! 



(14.30) 



Multiplying this out, however, shows that equality does not hold. Consequently, this coun- 
terexample proves that the matrix of inertias defined in Eq. (14.21) is not the matrix asso- 
ciated with a tensor! 

The inertia TENSOR 

Now we are left with the question: Is there any way to organize the inertias into a 
matrix form that does correspond to a tensor? The answer to this question is "yes!" Sim- 
ply putting negatives on the off-diagonals turns out to define a properly invariant tensor 
matrix: 



m 



Vxx 


-Vxy 


~Vxz 


~Vyx 


Vyy 


~Vyz 


-v« 


-v zv 


Vzz 



(14.31) 



This new definition corresponds to a tensor if and only if, for any two Cartesian coordinate 
systems, 



m 



w.r.t. 
{xyz} 



{xyz} 



Must hold true for all [Q]. 



(14.32) 



where [Q] is the direction cosine matrix. 



Let's first check whether placing negatives on the off-diagonals fixes our previous 
counterexample. With our new definition for the inertia tensor, we now ask whether nega- 
tives on the off-diagonals of the inertia tensor in Eq. (14.30) will make that equation true. 
In other words, is the following matrix equation true? 



/2 -1/2 




4= -- o 

72 72 





72 72 


1/2 1/2 
1^ 




72 72 
1 


1 
1 


--4=0 

72 72 
1 



This equation is true! 



(14.33) 



Multiplying this out shows that equality holds. Passing this test is necessary, but not suffi- 
cient for Eq. (14.32) to hold. The fact that one example (i.e., one choice for [Q]) worked 
out okay does not prove that our new definition really does correspond to a tensor. We 
don't know for sure (yet) whether or not some other counterexample might prove that our 
new definition isn't a tensor either. It is always harder to prove something true than to 
prove it false! 



Keep in mind: we are trying to prove that it doesn't. 
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It turns out that our new definition does indeed transform properly for all possible 
coordinate changes. One of the simplest ways to prove that a matrix construction rule is in 
fact a properly invariant tensor rule is to find some way to write out the definition in direct 
(Gibbs) notation using only operations (such as the dot product and dyadic multiplication) 
that have already been proved to be valid tensor operations. 

We recognize that the expression x 2 + y 2 that appears in the definition of \|/ zz can be 
written as (x 2 + y 2 + z 2 )-z 2 , or simply x*x-z 2 , where the position vector is 
x = xe v + ye + ze„ = xe~ + ye~ + ze~ . This observation lets us introduce at least a bit of 
direct notation into the formula. Note that the off-diagonals of the dyad —xx are identical 
to the off-diagonals of our new inertia matrix. The diagonal components of -xx are -x 2 , 
-y 2 , and -z 2 , which are exactly the same as the terms we used to rewrite the diagonals of 
the new inertia matrix. For example, the zz component x 2 + y 2 was re- written as 
x • x - z 2 . With a bit of thought, we therefore recognize that the inertia tensor may be 
written in the following clean direct notation: 

® = \\\i(x*x)I-xx]pdV (14.34) 

n 
By discovering this direct notation formula, we have relieved ourselves of the burden of 
proving invariance under coordinate transformations. The direct notation operations them- 
selves (namely: dyadic multiplication, tensor addition, scalar multiplication, vector dot 
product) have all been individually proven invariant in separate analyses. Any object con- 
structed using these invariant operations must itself be invariant! 
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"Engineers, like artists, often fall in love with 
their models. " — Tom Bement 

15. Scalar invariants and spectral analysis 

Invariants of vectors or tensors 

A scalar invariant of a vector or tensor is any scalar-valued function of the vector or 
tensor that gives the same result even upon a change in basis. 

The sum Vj + v 2 + v 3 is not an invariant of a vector v because the sum v x + v 2 + v 3 
with will generally give a different result when computed with respect to a different basis. 
However, the sum of the squares is an invariant, as was proved on page 179. 

The sum T\ x + T\ 2 + T% 3 of the squares of the diagonal components of a tensor, T is 
not an invariant of a tensor because the result is generally different for different bases. 
However, the sum of the diagonal components T x x + T 22 + ^33 alone does turn out to be 
an invariant because, for any orthogonal Q.. direction cosine matrix, 

Ml + ^22 + ^33 = T kk 

= TijQikQjk ( now use orthogonality) 

= h 

= f n + T 22 + hi (15.1) 

Primitive invariants 

As mentioned earlier, the magnitude of a vector is an invariant. Likewise, the square 
of the magnitude is also an invariant. These two invariants are not independent. One can 
always be computed from the other. In general, if a and p are invariants, then any scalar- 
valued function of them will also be invariant itself. 

Primitive invariants of a vector or tensor are any minimal set of invariants such that all 
other invariants may be expressed as functions of the primitive invariants. 

A vector has only one primitive invariant — its magnitude. Symmetric tensors (of class 
VV) have three primitive invariants. This follows because symmetric tensors have three 
eigenvalues. Since an invariant may be computed in any basis with the same result, all 
invariants of symmetric tensors must be expressible as functions of the tensor's eigenval- 
ues {A, 1? X 2 , A, 3 } . For example, the magnitude of a symmetric tensor is an invariant that 
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may be written as X\ + X\ + Xi . Nonsymmetric tensors have more than three primitive 
invariants. For nonsymmetric tensors, the magnitude is itself an independent invariant that 
cannot be expressed as a function of the eigenvalues. To prove this statement, consider a 
tensor whose component matrix with respect to some particular basis is given by 



(15.2) 



The eigenvalues are { X x , X 2 , X 3 } , but the tensor magnitude is X 2 + X\ + Xj + a 2 , which 
depends on the "12" component W . Different values of a will give different magnitudes. 
Hence, the magnitude must not be expressible as a function of the eigenvalues. Tensor 
magnitude is an independent fourth invariant for nonsymmetric tensors! Don't let anyone 
tell you that a tensor is zero if all of its eigenvalues are zero — that statement is true only 
for symmetric tensors! 



\ 


a 








Ao 











^3_ 
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Trace invariants 

Three popular invariants of a second-order tensor are 

I = trT 

II = tr(T^) 

III = tr(J 3 ) 



(15.3) 



For symmetric tensors, these form an acceptable set of primitive invariants. A symmetric 
tensor is zero if and only if these three invariants are all zero. This statement if false for 
nonsymmetric tensors, as can be readily verified by putting X,j = X 2 = X 3 = and 
a = 1 in Eq. (15.2). If the eigenvalues are known, then the trace invariants are given by 



I — L + X 2 "I" A/3 
// = A.2 + A.f + X] 

III = xj + xj + xj 



(15.4) 



Characteristic invariants 

The characteristic invariants of a second-order tensor T are defined by 
I k = the sum of all possible kx k principal subminors 



(15.5) 



Here, a kx k principal subminor is the determinant of a matrix formed by striking out 
rows and columns of the component matrix [ T] until all that is left is a kx k matrix 
whose diagonal components are also diagonal components of the original tensor [T] . The 
I k principal invariant requires you to find all of the possible ways to construct a kx k 
principal subminor and to sum their determinants. 

For a tensor referenced to 3D space, the component matrix is 3 x 3 and the character- 
istic invariants are 



/, 



Ml + M2 + ^33 



I 2 = det 



det 



^11 M2 


+ det 


T 22 T 23 


+ det 


Ml M3 


T 2l r 2 2 




_^32 ^33_ 




Ml M3_ 



Ml 


M2 


M3 


Ml 


T 

M2 


T 

M3 


.Ml 


M2 


M3_ 



(15.6) 



These are called the characteristic invariants (or principal invariants [24]) because they are 
coefficients in the characteristic equation that gives the eigenvalues of T. Namely, the 
eigenvalues of a tensor T are the solutions of 
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X 3 -I l X 2 + I 2 X-I 3 = (15.7) 

This equation is true even if the tensor T is nonsymmetric. For symmetric tensors, the 
characteristic invariants are an acceptable set of primitive invariants if the tensor is sym- 
metric. In other words, all other invariants of a symmetric tensor may be expressed as 
functions of the characteristic invariants. A symmetric tensor is zero if and only if its char- 
acteristic invariants are all zero. This statement if false for nonsymmetric tensors, as can 
be readily verified by putting X l = X 2 = X 3 = and a = 1 in Eq. (15.2). 

If the eigenvalues of the tensor are known, then the characteristic invariants are given 
by 

7i = A. 4- X 2 4- X-, 

lry = L Xry 4" X ryK -, 4" X-, L 

1-, = X-iX 2 X-> (15.8) 

Comparing with Eq. (15.4), note that the characteristic invariants are related to the trace 
invariants by 

tr(P = h 
tr(j2) = I\-2I 2 

tr(r 3 ) = I\ - 31^ + 37 3 (15.9) 

These relationships hold only for second-order tensors referenced to a 3D space (class 
V\ ). However, the basic definitions of the characteristic invariants and their relationship 
with the characteristic equation extend analogously to other dimensions. For second-order 
tensors referenced to a 4D space (i.e., class V\ tensors, whose component matrices are 
4x4), the characteristic equation is X 4 - I^X 3, + I 2 X 2 -I^X + 1 4 = . For second-order 
tensors referenced to a 2D space (class V 2 , for which the component matrices are dimen- 
sioned 2x2), the characteristic equation is 



x 2 -i 1 x + i 2 = o, where i x = t u + t 22 and i 2 = det 



^11 T \2 
T 2\ ^22 



(15.10) 



Applying this formula is the fastest and least error-prone way to quickly write down the 
characteristic equation of a 2 x 2 matrix. 
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Direct notation definitions of the characteristic invariants. 

The invariant definitions that we have given so far demand that the underlying basis must 
be orthonormal. Some more advanced texts (e.g., [21]) cite more abstract, and therefore 
more broadly applicable, definitions of the characteristic invariants. These definitions are 
phrased in terms of the triple scalar product, [( ), ( ), ( )] , defined in Eq. (5.36). 
Namely, in 3D, I x , I 2 , and I 3 are defined such that, for any vectors, u, v, and w, 

[ T» u, v, w] + [u, T* v, w] + [u, v, T* v] = I x [«, v, w] (15.11) 

[u, T* v, T» w] + [T» u , v, T* w] + [ T» u, T» v, w] = 7 9 [u, v, w] (15.12) 

[T»u, T»v, T»w] = I 3 [u, v, w] (15.13) 

Note that the left hand side in the equation for I x sums over every possible way the tensor 
T can operate on exactly one of the vectors in the triple scalar product. Similarly, I 2 
involves sums over every possible way the tensor can act on two of the vectors and 7 3 
involves sums over every way (only one way) for the tensor to act on all three vectors in 
the triple scalar product. 

Admittedly, these definitions are rather strange looking, and we have omitted the proof 
that the right hand side can, in every instance simplify to a scalar (the invariant) times the 
triple scalar product [a, v, w] . Nonetheless, expressions like these show up occasionally 
in analyses, and it is essential to recognize how beautifully they simplify. Furthermore, 
these definitions are a nice place to start when attempting to deduce how to compute the 
tensor invariants for irregular (non-orthonormal) bases. 

The cof actor in the triple scalar product. We close this discussion with a final 
identity, involving the cofactor tensor. Recall the direct notation definition of the cofactor, 
given in Eq. (9.46): 

G c • (« x v) = (G • «) x (G • v) for all vectors u and v (15.14) 

Dotting both sides of this equation by a third arbitrary vector w gives 

[G c »(uxv)]»w = [(G»u)x(G»v)]»w (15.15) 

The right-hand side is the triple scalar product [G*u,g»v,w]. Using Eq. (8.17), The left- 
hand side can be written [(u * v) • G CT ] » w or («xv)»[G ct »h>], which is the triple scalar 
product [«, v, G CT » w] . Thus 



[G»u, G»v, w] = [«, v, G CT »w] 



(15.16) 



This result shows that, when a tensor acts on two arguments in a triple scalar product, it 
can be recast as the transpose of the cofactor acting on the previously un-transformed 
(lonely) third vector. By the cyclic property of the triple scalar product, we can assert that 
this statement holds true when the tensor is acting on any two vectors in a triple scalar 
product. 
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Applying the above identity to the left-hand-side of Eq. (15.12), and then applying the 
definition of trace given in Eq. (15.11) shows that 



h = tr r 



(15.17) 



Of course, this result also follows directly from Eqs. (15.8) and (3.94). 



Invariants of a sum of two tensors 

Consider the sum T = A + B of two tensors. The first invariant is simple enough 
because the trace of a sum is the sum of the traces. Thus 

jA+B = trA + trB = If + If (15.18) 

Solving Eq. (15.96) for I 2 gives a formula for the second invariant: 

h = ^?-tr(T 2 )) (15.19) 

When applied to T = A + B , the result is 

H +B = ^(( tr 4 + tr 4f) 2 - tr (4+4f) 2 ) ( 15 - 2 °) 

which simplifies to 

If +B = If + I B + If If - tr(A • B) (15.21) 

Without proof, the determinant of a sum can be written 

If +B = det(A+B) = If + If + A C :B+A:B C (15.22) 

CASE: invariants of the sum of a tensor pius a dyad. Now suppose that the 
tensor B is actually a dyad: 

B = uv (15.23) 

Then 

B c = (15.24) 

If = «»V (15.25) 

if = (15.26) 

If = (15.27) 

Thus, the invariants of J = A + uv are 

if = tr(A + uv) = trA + u»v (15.28) 

I% = lf + (trA)(u»y)-y»A»u (15.29) 
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7 3 r = det(,4 + uv) = deU + u • A c • v (15.30) 

The last equation is especially useful in the analysis of the acoustic tensor for determining 
plastic wave speeds and modes. 
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The Cayley-Hamilton theorem: 

A tensor satisfies its own characteristic equation. That is, 

T 3 -I l t 1 + I 1 T-I 3 I= 0, (15.31) 

where / is the identity tensor, and is the zero tensor. This theorem is trivial to prove if 
the tensor is symmetric, but the proof is quite subtle if the tensor is non-symmetric [see 
Ref 26]. 

The above theorem provides a means of writing powers of a tensor in terms of second 
or lower powers. For example, multiplying Eq. (15.31) by T and solving for T 4 gives 

r 4 =/ 1 r 3 -/ 2 r 2 + / 3 r 

= i^^t 2 - i 2 t '+ I 3 I) - i 2 t 2 + i 3 t 

= (/^-/ 2 )r 2 + (/ 3 -/ 1 / 2 )r+/ 1 / 3 / (15.32) 

where, in the second step, we used Eq. (15.31) to substitute for T 3 . 

CASE: Expressing the inverse in terms of powers and invariants. 

We can multiply both sides of Eq. (15.31) by T~ l and then solve for T~ l to obtain 

T^-LT + I.I 
T~ l = - =2 (15.33) 

^3 



CASE: Expressing the cofactor in terms of powers and invariants. 

Knowing that the inverse can also be written T~ l = — — , the above result show us that 
5 * detJ 

T CT = P--I X T + I 2 I (15.34) 



Eigenvalue problems 

Consider a general tensor, A . A vector p is called a "right" eigenvector of A if and 
only if A • p is proportional to p . In other words, there must exist a scalar X , called the 
"eigenvalue," such that 

A »p = Xp (15.35) 

Eigenvectors are also called principal directions. Note that if an eigenvector can be 
found, its magnitude is arbitrary because any scalar multiple of an eigenvector would also 
be an eigenvector. Thus, if we say that an eigenvector is unique, we really mean that its 
direction is unique. 

Rewriting Eq. (15.35), we seek p and X such that 
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[A-XI]»p = (15.36) 

The only way that this equation can hold is if the tensor in brackets is singular. Hence, X 
must satisfy 

det[A-XI] = (15.37) 

Since we are speaking of ordinary tensors in ordinary 3D physical space, expansion of this 
determinant gives a cubic equation for the eigenvalue X . Specifically, it can be shown that 
this "characteristic equation" is 

X 3 -I l X 2 + I 2 X-I 3 = (15.38) 

where I t are the invariants of Eq. (15.6). Once an eigenvalue is found, the corresponding 
eigenvector is determined by enforcing the definition of Eq. (15.35). For two-dimensional 
problems, a graphical tool called Mohr's circle, is also very useful for performing eigen- 
value analyses.* 

Rebecca: discuss possibility of complex eigenvalues 

Because the equation is cubic, there are up to three distinct eigenvalues, { X v X 2 , X 3 } . 
Hence there is the potential for having up to three associated eigenvectors, {p.,p 2 ,p 3 } , 
but there might be fewer (as explained below). Any linear algebra textbook contains the 
proof that the eigenvectors corresponding to distinct eigenvalues will be linearly indepen- 
dent. In other words, 

If X t ^ X- , then p . and p . are linearly independent. (1 5.39) 

For symmetric tensors, the following stronger statement holds 

For symmetric tensors, 

if X t ^ Xj , then p . and p . are orthogonal. (1 5.40) 

Since the magnitudes of eigenvectors are arbitrary, it is customary to scale them to unit 
length so that distinct eigenvectors for symmetric tensors are not only orthogonal, but also 
orthonormal. As discussed later, a different convention applies for non-symmetric tensors. 

Algebraic and geometric multiplicity of eigenvalues 

If all three eigenvalues are distinct (i.e., if there are no repeated roots), then the three 
eigenvectors are linearly independent and may be used as a basis for the 3D physical 
space. 

When two or more eigenvalues are equal, however, the situation becomes more com- 
plicated. The algebraic multiplicity of an eigenvalue is the number of times the eigenvalue 
repeats as a solution to Eq. (15.38). The geometric multiplicity of an eigenvalue is the 
number of linearly independent eigenvectors associated with the eigenvalue. There is 



* An extremely detailed exposition on Mohr's circle, including its definition for nonsymmetric ten- 
sors is provided in Ref. [9]. More elementary discussions may be found in virtually any undergrad- 
uate text on mechanics of materials. 
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always at least one eigenvector associated with each eigenvalue. For repeat roots, the geo- 
metric multiplicity is always less than or equal to the algebraic multiplicity The distinc- 
tion between geometric and algebraic multiplicity is important only for nonsymmetric 
tensors because (as any good matrix analysis will prove), 

For a real symmetric tensor, the geometric multiplicity always 
equals the algebraic multiplicity. 

Consequently, a symmetric tensor will always have a complete set of linearly independent 
eigenvectors that may be used as a basis for 3D space. Such a basis is sometimes called an 
eigenbasis. 

For repeated eigenvalues, the associated eigenvectors do not have unique directions. If 
the geometric multiplicity is two, then there are exactly two associated linearly indepen- 
dent eigenvectors. These two eigenvectors may be used to define a plane in 3D space. The 
eigenvectors associated with the eigenvalue of geometric multiplicity two are unique to 
the degree that they must lie in that plane, but their directions (and, of course, magnitudes) 
are arbitrary. If desired, they may be scaled such that they are any two orthonormal vectors 
in the plane. These statements apply even to nonsymmetric tensors. For symmetric ten- 
sors, in light of Eq. (15.40), we note that 

A symmetric tensor always has an orthonormal eigenbasis. (1 5.41 ) 

A normalized eigenbasis is often denoted with different symbols, { 8., 8 2 , 8 3 } to empha- 
size that it has been selected such that 

§•8. = 8,.. (15.42) 

Although not guaranteed, it may so happen that a particular non-symmetric tensor of 
interest also has all of its geometric multiplicities equal to the algebraic multiplicities. In 
such a case, that tensor also possesses a "spanning" set of eigenvectors {p v p 2 ,p 3 } that 
may serve as a basis for 3D space. However, 

If a non-symmetric tensor happens to have an eigenbasis, 

then the eigenbasis will not be orthogonal. (1 5.43) 

A non-orthogonal eigenbasis {p,,p 2 ,p 3 } always has a "dual" basis {/J 1 ,/* 2 ,/* 3 } that is 
defined such that 

pi* p. = b), (15.44) 

where the 8 ■ is an alternative symbol for the Kronecker delta and p' is the complex conju- 
gate of p' . Comparing Eqs. (15.44) with (15.42) shows that the dual basis associated with 
{8,8,8} is just { 8 ., 8_, 8. } itself, so there is no need to worry about a dual basis for 
symmetric tensors. 
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Diagonalizable tensors (the spectral theorem) 

Whenever a tensor possesses a spanning set of eigenvectors, {p.,p 2 ,p 3 } (i.e., when a 
tensor has an eigenbasis), then the tensor is said to be "diagonalizable." In matrix anal- 
ysis, this means that the matrix [A] ee containing the components of A is with respect to 
the laboratory basis {e v e 2 , g 3 } is similar to a diagonal matrix [A] containing the eigen- 
values on the diagonal. In other words, there exists a matrix [L] such that 



[A] ee = [L][A][L]~ l (15.45) 



where 



\ 











x 2 











A-3_ 



[A] = OLO (15.46) 



Comparing Eq. (15.35) with (15.45), we note that the columns of the matrix [L] must 
contain the components of the three eigenvectors {p,,p 2 ,p 3 } with respect to the 
orthonormal laboratory basis. If the tensor A is symmetric, the eigenvectors will be 
orthonormal and [L] will be orthogonal. 

Using vector basis notation, Eq. (15.45) implies that the tensor A can be written as the 
sum of three "eigen-dyads": 

4 = X iP\P! + X 2P 2 P 2 + X 3P 3 f > ( 15 - 47 ) 

where the eigenvectors are here presumed to satisfy the normalization of Eq. (15.44) so 
that, indeed, A • p. = Xfl. (no sum on /). Incidentally, note that 

p'»A = X'p' (15.48) 

The dual vectors p l , are sometimes called the "left" eigenvectors by virtue of the above 
relationship. It is apparent that the left eigenvalues are the same as the right eigenvalues, 
and the left eigenvectors are the right eigenvectors of A T . 

If the tensor is symmetric, there's no distinction between the two types of base vectors, 
and Eq. (15.47) can be written as simply 

If A is symmetric, then A = X l 8.8 1 +X 2 $ 2 S 2 +X38-8, (15.49) 



Eigenprojectors 

Consider a diagonalizable tensor A for which two eigenvalues are repeat roots. Sup- 
pose, for example, X 2 = X 3 . Then Eq. (15.47) can be written 

4 = X iPlP 1+X 2(P 2 P 2+ P3P 3 ^ ( 15 - 5 °) 

or 
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A = X,,P, +A, 9 P n , (15.51) 

where 

By virtue of Eq. (15.44) we note that 

P l »P l =P l and P 2 *P 2 = f 2 (15-53) 

Consequently, the P tensors are projectors, called eigenprojectors. Furthermore, 

P l -P 2 = *' (15 - 54) 

Finally, since the eigenvectors form a basis, it can be shown that 

P l +P 2 = I (15 - 55) 

Comparing these results with Eq. (10.32) reveals that the eigenprojectors are complemen- 
tary projectors and the number M in Eq. (10.32) is equal to the number of distinct eigen- 
values. Because X 2 = X 3 , the directions of eigenvectors p 2 and p 3 are not unique — 
they only need to reside in the plane defined by their span. However, even though the 
directions of p 2 and p 3 are not unique, the sum, p p 2 +P 3 p 3 , is unique! In other words, 
the eigenprojector associated with the double root X 2 is unique. Furthermore, note that the 
dimension of the range space for each eigenprojector equals the multiplicity of the eigen- 
value. 

If all of the eigenvalues of the tensor instead had been distinct, we could have per- 
formed a similar analysis to obtain 

A = X,P, + X 7 P n + k,P, , (15.56) 

where 

P 2 -Pit 

P ^P.lt ( 15 - 57 > 

and the properties of Eq. (10.32) would again hold, this time with M=3 . 

P • P = P if;-/' so each P is a projector (15.58) 

P »P = if i*i (15.59) 

P x +P 2 +P 3 = I (15.60) 

Likewise, if all three eigenvalues had been equal (triple root), then the number of distinct 
eigenvalues would be M= 1 , and the same process would (trivially) give 
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A = XI, (15.61) 

where we note that the identity tensor itself is a (degenerate) projector. 

These concepts can be generalized to fourth-order tensors, where (instead of eigenvec- 
tors) we will find elgentensors. The idea of eigenprojectors is extremely useful in this 
case, especially in the study of material anisotropy. 
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"Knowledge is a process of piling up facts. 

Wisdom lies in their simplification. " 

— Martin H. Fischer 

16. Geometrical entities 



Equation of a plane 

A plane in 3D space can be described completely by specifying the plane's orientation 
by a unit normal n and the distance "d" of the plane from the origin. Physically, we know 
that any position vector x that points from the origin to a location in the plane must have a 
projection onto the plane's normal that is identically equal to equal to the distance "J". 
Thus, the direct notation equation for a plane is 

x* n = d (16.1) 

Written out in component form, 

jtj/ij + x 2 n 2 + x 3 n 3 = d (16.2) 

Even though a plane is a two dimensional object, it takes three independent parameters to 
specify it. The unit normal has two independent components (the third being restricted to 
ensure that ||«|| = 1) and the distance d makes the third parameter. When the plane 
passes through the origin (d=0), it is a linear manifold. Otherwise, it is called an affine 
space. 

If the plane does not pass through the origin (i.e., if d^ 0), then the equation for the 
plane may be written 

n 
x*u= 1 , where u = - r (16.3) 

~ ~ ~ d 

In this case, \/u i equals the intercept of the plane on the z th axis of the Cartesian coordi- 
nate triad. If the plane does pass through the origin, then the equation of the plane is just 

x*n = (16.4) 

The equation of a plane passing through a particular point p is therefore 

(x-p) •n = (16.5) 
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Equation of a line 

Consider a straight line that passes through one point x l and a second point x 2 . The 
easiest way to define the set of position vectors x that extend from the origin to some 
point on the line is to write the equations in parametric form by simply expressing the fact 
that the vector from x { to any point on the line must be parallel to the vector from Xj to 
x 2 . Letting the proportionality factor be denoted by "f ', the parametric equation for a line 
can be written 



(x-Xj) = t(x 2 -x l ) 



(16.6) 



Since this is a vector expression, it represents a set of three separate equations. If the 
parameter t equals zero, then x is located at x, . If t=\ , then the point x is located at x 2 . 
Of course, values of t outside the interval from to 1 are permissible as well, and will 
result in position vectors outside the line segment from x { to x 2 . 

An alternative parametric equation for a line is 

y = an 

where 

y = x--(x l +x 2 ), « = - — j— , and L = \\x 2 -x l \\ (16.7) 

The parameter a varies from -L/2 to +L/2 as x varies from X-, to x 2 . 

More generally, one can define a line by any point p on the line and the orientation n 
of the line. Then the equation of the line can be written 



y = an 



(16.8) 



where 



and n defines the orientation of the line (16.9) 

Dotting both sides of Eq. (16.8) by n shows that 

a = y • n (16.10) 

This expression for a may be substituted back into Eq. (16.8) to give a non-parametric 
version of the equation of a line: 



y = (y*n)n 



(16.11) 



Physically, this says that the projection of y onto n equals y itself. Even though Eq. 
(16.11) is non-parametric, it is still a vector equation, so it really represents three simulta- 
neous equations. These three equations are not independent. Given arbitrary choices for 
y l and y 2 , it is not generally possible to solve Eq. (16.11) for y 3 . Certain solvability con- 
ditions must be met in order for a solution to exist; namely, the above equation may be 
solved for y 3 if and only if y x n 2 = y 2 n l . This solvability condition is expressing the 
requirement that y l and y 2 must fall on the "shadow" cast by the line onto the 1-2 plane. 
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Equation (16.11) is non-parametric, but it is still a set of three distinct equations. It can 
be expressed as a single equation by noting that two vectors q and b are equal if and only 
if («- b) • (q-b) = 0. Therefore, an equivalent version of Eq. (16.11) is 



yy = (y»Y 



(16.12) 



Any of the above boxed equations may be used as an equation of a line in 3D space. 
All but the last equation are vector expressions, so they actually represent a set of three 
equations, each of which involves a linear combination of the position vector components. 
The last equation is a single (scalar-valued) expression for a line, but the price paid for 
having a single equation is that the position components appear in quadratic form — 
pretty odd given that it represents the equation for a linear (straight) line! 

Equation of a sphere 

A sphere is defined as the set of points that are equidistant from the sphere's center. 
Therefore, if a sphere of radius R is centered at a point p , then its equation is simply 



(*-/>)•(*-/>) = R 2 



(16.13) 



Equation of an ellipsoid 

Suppose you wish to define an ellipsoid in 3D space that is centered at the origin and 
whose principle axes are parallel to three vectors {q v q 2 ,q 3 } and whose principal radii 
are given by the magnitudes of these vectors. With respect to a coordinate system that is 
aligned with the principle directions, the equation of the ellipsoid is 



i An -V 



— + — + — = 1, where a, = llajl (16.14) 

222 * M**ll 

CX i CXn CXo 

If, however, the principle axes are not coincident with your basis, then the equation for the 
ellipsoid takes on a more general quadratic form. Namely, 

x»B»x = 1, (16.15) 

where the tensor B is defined by the inverse of the dyad sum 

4 = a ~k a ~k ( 16 - 16 ) 

Since the q k are (by premise) mutually perpendicular, we know that they must be eigen- 
vectors of the tensor A . Consequently, the eigenvalues of the tensor are a k = ||«J| and the 
inverse of the tensor is 

3 

zAdE (1617) 
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Example. Suppose that 



Qi = e x + e 2 



q 2 = 4(-e l + e 2 ) 





«3 


= 3 ?3 


The 


magnitudes are 




a,] 


= 72 




a 2 


= 472 




a 3 


= 3 


The 


dyads 


are 



(16.18) 
(16.19) 
(16.20) 

(16.21) 

(16.22) 
(16.23) 



It | It | C-lC-1 ' %Z "\ C- 1 ' (• 1 C- n "T" C- n C- n 



-> 



1 1 
1 1 




(16.24) 



«2#2 



16(g 1 g 1 — e 2 €i ~~ €i?2 + €2-2) 



-> 



16 


-16 


-16 


16 









(16.25) 



Thus, 



fljflj 



9?3?3 



-> 





9 



(16.26) 



M 



(V2) 4 



1 1 
1 1 




(4V2) 4 



16 -16 

-16 16 





3 4 





9 



(16.27) 



or 



[4 



U I! 

64 64 
64 64 







Thus, the equation for the ellipsoid is 

12 2 + iZ 2 + I 2+15 ,15 = , 

64 Xl 64 X2 9 X3 64 XlXl 64 X 2 Xl 



(16.28) 



(16.29) 



Of course, the last two terms, which come from the off-diagonals, may be combined, but 
we left them separated to emphasize the structure of the solution. 
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Equation of a cylinder with an ellipse-cross-section 

The equation for a cylinder whose cross section is an ellipse could be regarded as a 
degenerate case of the above ellipsoid for which one of the specified vectors, say « 3 , is 
infinite in magnitude. In this case, only the first two direction vectors, q { and « 2 are 
needed to specify the geometry of the cylindrical ellipsoid. In this case, Eq. (16.17) 
becomes 

(1,(1, a a 

B = zJ—l + z£zI (16.30) 

» 4 4 v ' 

Equation of a right circular cylinder 

The special case of a circular cylinder of radius r follows from Eq. (16.30) by taking 

«1 = « 2 (16.31) 

where 

a l = a 2 = r (16.32) 

Then Eq. (16.30) becomes 

e,e, + e e I-nn 
B = ^ — =2=2 = = (16.33) 

w 2 2 

Here, e is the unit vector in the direction of a and n is the unit vector in the direction of 
the cylinder axis. The final step in Eq. (16.33) followed from the fact that the cylinder axis 
is perpendicular to the first two directions. With that result, Eq. (16.15) becomes simply 

x»x-(n •x) 2 = r 2 (16.34) 

or 

||x — «« • x\\ = r (16.35) 

Equation of a general quadric (including hyperboloid) 

A quadric surface is governed by an equation of the form 

x»B»x = 1 (16.36) 

As already discussed, this form is capable of describing an ellipsoid. However, that is just 
one class of surfaces described by the form. Without loss, the B may be presumed sym- 
metric (if not, then it must be symmetrized in order for the comments in this section to 
remain true). 

An ellipsoid corresponds to the case that the B tensor is positive definite. If the B ten- 
sor possesses negative eigenvalues, then the quadric surface is a hyperboloid. 
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Generalization of the quadratic formula and "completing the 
square" 

Consider a spatially varying field given by an equation of the following form: 

\|/ = X »A • x + b • x + c (16.37) 

As long as A is invertible, we claim that there exists a symmetric tensor B such that this 
field can be written in the form 

¥ = (%-p) ••§ * (x-p)-d (16.38) 

Expanding this out, recognizing the B may be presumed symmetric without loss, gives 

\\f = x» B •x-lfB »x+p» B »p-d (16.39) 

Equating this expression with Eq. (16.37) gives 

B = A (16.40) 

-2p»B = b (16.41) 

p»B»p-d = c (16.42) 

The last two equations can be solved for p and d . Thus we have the result: 
Ifvi/ = x* A »x + b »x + c 

T M m M M M 

then v|/ = (x-p) »A» (x-p) + d, 

where o = --A~ l • b and d = -b • A~ l • b - c (16.43) 

Written out in full, 

v = |*+^- 1 -*|-4-|* + ^- 1 -*| + Q*-4- 1 -*-^ 

(16.44) 
We will be interested in describing the shape of surfaces of constant \\f . Such surfaces can 
be described by considering only the case that \|/=0 , because nonzero \\i values of \\i can 
always "absorbed" into the parameter "c." For the case that \|/=0 , Eq. (16.37) is like a ten- 
sor version of a quadratic formula, so inquiring minds want to know what is the analog of 
the quadratic formula. In particular, what is the analog of the discriminant? To answer this 
question, let's define 

y = 2A»x + b (16.45) 

or, solving for x , 

x = \A~ l *{y-b) (16.46) 
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With this change of variables, Eq. (16.44) becomes 

4v|/ = A~ l :[yy + bb]-4c (16.47) 

Suppose that \j/=0 . Then, if this result were for scalars rather than tensors, it would read 

= -[y 2 + b 2 ]-4c, or y = ±Jb 2 -4ac (16.48) 

a 

Thus, we see that the vector y plays a role similar to that played by the discriminant in 
scalar quadratics! As a matter of fact, note that Eq. (16.46) can be written 

x = (2A)- l »(-b+y), (16.49) 

which is the analog of the scalar quadratic formula, x = =-^ . In the scalar 

quadratic equation, there were only two values of y that would make \|/=0 . By contrast, 
for the tensor case, setting \|/=0 gives 

= 4~ l :\yy + bb]-4c (16.50) 

or, written in a somewhat different manner 

y 

y*»A- l »y* = 1 , where y* = (16.51) 

b*A l »b- 4c 



which describes a quadric surface (i.e., & family of y vectors exists that will make v|/=0). 
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"Our ability to delude ourselves may be 

an important survival tool. " 

— Lily Tomlin 

17. Polar decomposition 

Singular value decomposition 

Let [F] M x N denote anMxiV matrix. The "singular value decomposition" theorem 
from matrix analysis [26, 34] states there exist matrices [q] MxM , [r] NxN , and [A] MxN 
for which 



* 



(v) [q] and [r] are orthogonal . 

(vi) [A] is "pseudo-diagonal" (i.e., A- ■ = whenever i ^j) 

(vii) [A] is positive semi-definite in the sense that its diagonal 
(i=j) components, A- , are non-negative. 

such that [F] can be written 

T 
[FlMxN = iQiMxML^iMxN^lNxN ( 17 -1) 

is valid. The numbers A? make up the eigenvalues of [F] r [F] (and the A ; are the non- 
negative square roots of A? , perhaps with some zeros added to fill out remaining diagonal 
slots in [A] ); the columns of [r] hold the associated "right singular" eigenvectors. Simi- 
larly, the numbers A? make up the eigenvalues of [F][F] r with columns of [q] holding 
the associated "left singular" eigenvectors. The proof can be found in any good matrix 
analysis book. The A ( are called the "singular values". 

Special case: M = N. Suppose now that all matrices have the same dimensions. 
Since [q] is orthogonal, we know that 

[q] T [q] = M (17.2) 

Therefore, Eq. (17.1), once specialized to square matrices, may be written without loss in 
the form 

[F] = [q][A][q] T [q][r], (17.3) 

or 



* As with most of the theorems cited in this book, this theorem does have a simple generalization to 
include the possibility that [F] is complex, in which case [q] and [r] would be unitary. For sim- 
plicity, this book considers only real matrices so, in this context, unitary means the same thing as 
orthogonal. 
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[F] = [V][R], where [V] = [q][A][q] T and [R] = [q][r] (17.4) 

Similarly, since [r] is orthogonal, we know that 

[r][r] T = [I] (17.5) 

Therefore, Eq. (17.1) may be written without loss in the form 

[F] = [Q][r][r] T [A][R], (17.6) 

or 

[F] = [R][U], where [U] = [r] T [A][r] and [R] = [q][r] (17.7) 

Note that [R] is itself orthogonal and that [U] and [V] are symmetric. Thus, the singular 
value decomposition guarantees the existence of symmetric matrices [ U] and [ V\ as well 
as an orthogonal matrix [R] such that 

[F] = [R][U] = [V][R] (17.8) 

The polar decomposition theorem: 

In tensor analysis (especially in continuum mechanics), the singular-value decomposi- 
tion theorem (specialized to invertible square matrices) is called the "polar decomposi- 
tion" theorem. Specifically, for each invertible tensor F there exists a unique orthogonal 
tensor R , a unique symmetric positive definite "right stretch" U, and a unique symmetric 
positive definite "left stretch" V such that 

F = R*U = V*R (17.9) 

A tensor is called a stretch if it is symmetric and positive definite. Physically, a stretch 
describes a deformation in which there is an orthonormal triad of material vectors that 
change length but not orientation. These special vectors are the principal directions of the 
stretch and the corresponding eigenvalues are the ratios of deformed length to undeformed 
length. A physical interpretation of the polar decomposition is shown in Fig. 17.1. Note 
that R • U represents a stretch U followed by a rotation R . 

In the polar decomposition theorem, the descriptors "symmetric" and "positive defi- 
nite" are requirements, not consequences. A stretch must be both symmetric and positive 
definite — merely showing that a tensor F is symmetric is not sufficient to prove that it is 
a stretch. For example, any rotation of exactly 180° will produce a symmetric F tensor, 
but it will not be positive definite. 

The classic analytical procedure for finding R, U , and V is as follows: 
• Construct a tensor C = F T • F, and perform a spectral analysis on it to find its 
eigenvalues C k and eigenprojectors P . Then C = C X P + C 2 P + C 3 P and 



If p k is the eigenvector associated with C k , then the eigenprojector P equals the dyad p, ®p k , 
where there is no sum on k. 
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U = C 1/2 = JC\P + JC 2 P 2 + JC 2 P . The positive square root must be taken to 
make U positive definite. 

• Compute £ = F*y~ l . 

• Compute V = R»U»R T . 

Alternatively, if only V is desired, it may be computed by V = (F • F T ) 112 . and then the 
rotation would be given by R = V~ l • F . An excellent proof of the polar decomposition 
theorem is in Ref [24]. An invalid proof can be found in Ref [18] where the authors 
wrongly assert that a symmetric F is a stretch, which is false because a 180° rotation is a 
symmetric tensor, but is not positive definite and therefore not a stretch; furthermore, 
Ref. [18] fails to prove uniqueness. 



* By computing U in the principal basis of C , we have ensured that it will be symmetric. In general, 
an N x N positive definite symmetric matrix like C can have an infinite number of square roots, 
of which only 2 are symmetric and only one is symmetric and positive definite. 
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Compress the \ 
material by half 
along the ellipse 
1-axis. T j 



then rotate 
/ the material 

counterclockwise 
9 by 60 degrees. 




First rotate 
the material 
counterclockwise r 
by 60 degrees. \ 



Then compress the 
material by half 
along the ellipse 
1-axis. 



Figure 17.1. Visualization of the polar decomposition. This figure shows that the deformation F can 
be visualized as two step process. The upper R • U path first applies the stretch V to compress the materi- 
al by a factor of 1/2 in the direction of the vector labeled Sf 7 and then the rotation tensor R rotates coun- 
terclockwise by 60° . The same deformation is achieved on the bottom path by first rotating by 60° and 
then compressing by a factor of 1/2 in the direction of the vector labeled 8f . In these figures, we have 
"painted" a circle (or sphere in 3D) on the reference cube to show how it becomes an ellipse (or ellipsoid 
in 3D). The vectors S 77 and 8^ lie on the major axes of the ellipse. 
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Incidentally, because R is orthogonal, it follows that R 
tion can be alternatively be computed by 

R = F~ T * U or by R = V • F~ T 

which is sometimes more computationally convenient. 



R T . Therefore, the rota- 



(17.10) 



Polar decomposition is a nonlinear projection 

Recall that the reference stretch tensor is computed by 

where the operator P is defined for any argument X by 
P(X) = +{X T *X) 111 



(17.11) 



(17.12) 



We have inserted the "+" sign in front of this equation to reiterate that the square root of a 
tensor is not unique, but the positive definite square root is unique. The transformation P 
is a projection in the sense defined in Eq. (6.44) because P(P(X)) = P(X) . In other 
words, if F is already a symmetric positive definite tensor, then its associated polar 
stretch is itself. 

Similarly, the rotation tensor, can be regarded purely as a function of F as follows: 



R = F^U- 1 = F»[+(X T »X) m ]- 1 = Q(F) 
The operator Q is defined for any argument X by 
Q{X) = X»(X T »X)- l/2 



(17.13) 



(17.14) 



The operator Q is a projector because Q(Q(X)) = Q(X) . In other words, if F is already 
a rotation, then its associated polar rotation tensor is itself. 

Neither of the projectors, P or Q, are linear operators. The codomain is not a linear 
manifold for either of these operators. The codomain for P is the set of all positive defi- 
nite symmetric tensors. It's true that the sum of two positive definite tensors is itself posi- 
tive definite; however, an arbitrary linear combination of positive definite tensors (i.e., a 
general combination that permits negative coefficients) will not be itself positive definite. 
The codomain of Q is the set of all orthogonal rotation tensors. This is not a linear space 
because adding two orthogonal tensors will not result in an orthogonal tensor. 

The *FAST* way to do a polar decomposition in 2D 

For planar deformations, the deformation gradient tensor has the form 



[F] 



11 


Fn 





21 


F22 











^33_ 



where F 33 > 



(17.15) 



209 

Copyright is reserved. Individual copies may be made for personal use. No part of this document may be reproduced for profit. 



September 4, 2003 5:24 pm 
Polar decomposition 



We claim by serendipity* that the polar decomposition can be performed rapidly by 
the following formula: 



[R] 



cos 9 


-sin9 


sin 9 


cos 9 





1 



and [U] = [R] T [F] 



(17.16) 



where 



cos9 



sin 9 



^11 + ^22 



7(F 11+ F 22 )2 + (F 21 -F 12 )2 

*21 _J ^12 



(F u +F 22 )2 + (F 2l -F n y 



(17.17) 



Beware! You must define cos 9 and sin 9 separately in order to uniquely determine the 
rotation angle. It is certainly true that 



tan9 = (F 2l -F n )/(F n +F 22 ) ; 



(17.18) 



but this relation does not uniquely define the rotation angle because there are always two 
angles 9 in the range from to 2n that satisfy the above equation. By contrast there is 
only one angle in the range from to 2k that satisfies Eq. (17.17). The following code 
fragment may be used to compute a polar rotation tensor in 2-D: 



c = F(l,l)+F(2,2); s = F(2,l)-F(l,2); 
d = Sqrt (c*c+ s*s) ; 
c=c/d; s=s/d; 
R(l,l)=c;R(2,l)=-s;R(l,2)=s;R(2,2)=c; 



A fast and accurate numerical 3D polar decomposition 

We have already described the classic analytical method for doing polar decomposi- 
tion in 3D. This method, unfortunately, entails finding the eigenvalues of a 3 x 3 matrix. 
Doing that requires solving a third-order characteristic equation. Analytical methods do 
exist for finding roots of third-order equations, but those methods actually entail a fair 
amount of computation, which makes them susceptible to round-off error and inefficiency. 
Below, we outline an iterative method for obtaining a polar decomposition. 

I Insert algorithm here 

* It's easy to verify that our formulas yield an orthogonal [R] and a symmetric [U]. It is straightfor- 
ward, but tedious, to also prove that our formula gives a positive definite [U] matrix. This property 
is essential in order to confirm the validity of our serendipitous formulas. 
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You might feel uncomfortable about using an iterative algorithm, but you shouldn't. In 
numerical implementations, iterative algorithms can sometimes give you more accurate 
results than analytical solutions when the analytical solutions involve numerous multipli- 
cations, square roots, and other round-off error producing operations. You can obtain max- 
imum accuracy from an iterative algorithm by testing for convergence against the machine 
precision. The machine precision is the largest number p for which (p+i . 0) -1 . o evaluates 
to zero on your computer. For most computers running double precision, the machine pre- 
cision p is in the neighborhood of 1 x 10~ 20 . Even analytical solutions cannot hope to 
achieve any more accuracy than machine precision. 



Dilation-Distortion (volumetric-isochoric) decomposition 

GOAL: Describe another (less common) multiplicative decomposition that breaks a tensor 
transformation into two parts, one part that captures size changes and the other part 
characterizing shape changes. 

Like the polar decomposition, a different multiplicative decomposition to be described 
in this section applies equally well to any tensor, but we will explain it in the physical con- 
text that the tensor is a deformation gradient F . The operation x = F • X describes a 
homogenous deformation of space in which the initial position vector X is deformed into 
a new location x . A region having volume V ' in the initial configuration will deform into 
a new region with deformed volume V, and the two volumes are related by 

V = jy o , where J^detF (17.19) 

The "Jacobian" J is sometimes called the dilatation. It is improper, in general, to alterna- 
tively use the term "dilation" because dilation properly means volume change without a 
change in shape.* A deformation tensor generally describes both changes in volume and 
changes in shape. For example, a cube will deform to a parallelepiped. The deformation 
will purely dilational (shape preserving) if and only if the deformation gradient is isotro- 
pic; hence, it would have to be proportional to the identity tensor, making it of the form 
al for some scalar a. Applying Eq. (3.99) for this special case of a 3x3 matrix, note 
that the determinant of al is given by a 3 . Since this determinant must equal the Jacobian 
J, we can assert that a = J 1/3 and therefore 

A tensor F is apure dilation if and only if F = J l/3 I, where J= detF. (17.20) 

On the other extremely we can consider a pure distortion deformation (also called an 
isochoric deformation), which is one that permits shape changes, but not volume 
changes. 

A tensor F is a pure distortion if and only if detF = 1 . (17.21) 



* Your pupils dilate when you see mouth watering food or an attractive person — your pupils grow in 
size, but still remain circular. Contrast this response with a feline's slit-like pupils which dilatate 
(not just dilate) in response to light — a cat's pupils change both size and shape. 
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The identity tensor is the only degenerate case that, according to these definitions would 
be simultaneously a dilation and a distortion. This case is degenerate because the volume 
does not change and the shape does not change. 

Now consider a tensor F that is potentially neither a pure dilation or a pure distortion. 
We wish to decompose this general deformation into two separate (multiplicative) steps, a 
dilation followed by a distortion. That is, we seek an isotropic tensor A and an isochoric 
tensor G such that F = A • G . Of course, since A is isotropic it will also be true that 
F = G • A . Knowing that detF = J and det(7 = 1 shows that det^ = J and therefore 

A = J 1/3 |, where J=detF. (17.22) 

from which it follows that 

G = J~ in F (17.23) 

Thermomechanics application. The dilation-distortion decomposition (DDD) is 
useful to resolve one particularly vexing issue in generalizing thermodynamics for gases 
to solids. In gas thermodynamics, the specific internal energy u is typically regarded as a 
function of the entropy s and the specific volume (v = 1/p). Consequently, by using the 
chain rule, the time rate of the internal energy can be written 

u = Ts-pv (17.24) 

where 

f), 

and 

T = (f)„ 

As written, p and T are merely mathematical entities lacking physical meaning. However, 
for gas dynamics, you can use the second law to assert that they must be the pressure and 
temperature respectively. The negative sign is used in Eq. (17.25) because, by convention, 
pressure is positive in compression. Another commonly used energy-like quantity, the 
enthalpy is defined 

h = u+pv (17.27) 

When generalizing to thermoelasticity of solids similar analysis techniques are used. 
The internal energy of a thermoelastic solid is presumed to depend on entropy s and some 
measure of strain or deformation, which we will denote V . This tensor is not the same as 
the tensor V from the polar decomposition, though some people might choose it to be 
since the polar stretch is a measure of deformation. Other people might choose V to be, 
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say, the Lagrange strain from continuum mechanics theory while others might choose V 
to simply be the deformation gradient F . Associated with your choice for V, there must 
exist a so-called "conjugate" specific stress tensor P such that the rate of internal energy 
can be written 

u = P:V+Ts (17.28) 

This is the solid mechanics analog of Eq. (17.24). There is a difference of sign in the 
mechanical p-v work term because, unlike gases, stress is typically taken to be positive in 
tension in solid mechanics. It can be shown that the generalization of Eqs. (17.25) and 
(17.26) are 

t - (i 

» s 

and 

Again, there is a sign difference in the first of these equations because of the sign conven- 
tion for stress. The generalization of the enthalpy in Eq. (17.27) is 

h = u + P:V (17.31) 

Typically, the tensor V chosen to be something dimensionless such as a strain or the 
deformation gradient tensor. Contrast this with the situation in gas dynamics where the 
analogous variable v has dimensions of 1/mass. In thermoelasticity, the specific internal 
energy must still be energy/mass. Hence, if V is dimensionless, P must have dimensions 
of energy per mass. Stress has dimensions of energy per volume. Therefore P can be 
regarded as a stress divided by density, which is why we called it a specific stress. Using 
concepts from continuum mechanics, the expression P: V, called the stress power must be 
expressible in any of the following forms: 

(17.32) 
(17.33) 

(17.34) 

Here, a is the Cauchy stress tensor (it is the stress tensor that undergraduate engineering 
studenfs learn about, defined to be force per unit deformed area), D is the symmetric part 
of the velocity gradient, p o is the initial density (equal to the current density p times the 
Jacobian J), s is the Lagrange strain [defined s = -(F T • F-I)], s is the Second-Piola- 
Kirchhoff stress [defined s = JF~ l • a • F~ T ], F is the deformation gradient tensor, and 
t is the First-Piola-Kirchhoff stress [defined t = Jo • F~ T = a • F c ]. 
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Although the tensor D is somewhat "rate-like" it is a well-known result from contin- 
uum mechanics that there exists no tensor V such that D = V. Consequently, Eq. (17.32) 
provides no guidance for assigning a mathematically well-founded meaning for V. On the 
other hand, Eq. (17.33) is of the proper structure to permit us to choose 

V = 6 andP = — § (17.35) 
Likewise, Eq. (17.34) admits the alternative choice 

V = FandP = — t (17.36) 

Is there anything that makes either of these two choices preferable? Either of these conju- 
gate pairs will give the same result for the stress power. However, these two choices will 
give different results for the product P:V that appears in the enthalpy Eq. (17.31). Con- 
sider, for example, a purely dilational (nondistortional) deformation for which F = J 113 1 
and (for an isotropic material) a = -pi. In this special case, noting that 

P = P J = J/v > 

—s:s = --pv(\-J- 2ly ) (17.37) 

p » * 2 

and 

— t:F = -3pv (17.38) 

Neither of these versions of P: V reduce to the same value, nor do they reduce to -pv 
from gas dynamics. Consequently, thermoelasticity theory with these conjugate pairs 
won't reduce down to classic gas and inviscid fluid thermodynamics when the material 
and the deformation are both isotropic. Another strain choice, the logarithmic or Hencky 
strain, also comes close to reducing to the gas equations, but using it entails serious com- 
putational overhead. At the root of the problem is the fact that gas thermodynamics is cast 
in terms of volumetric strains whereas solid mechanics is cast in terms of linear strains. 
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"Advice is what we ask for when we already 

know the answer, but wish we didn't." 

— Erica Jong 
V / 

18. Material symmetry 

The symmetry of a material is measured by how its properties vary with material ori- 
entation. If the material properties are unaffected by material orientation, then the material 
is said to be proper isotropic. If the material properties are additionally unchanged 
upon a reflection, then the tensor is strictly isotropic. If the material properties are unaf- 
fected by rotation about some given vector q , as for unidirectional fiber-reinforced plas- 
tics or plywood, then the material is transversely isotropic. The tensor theory of 
symmetries is covered in a rigorous and elegant manner through the use of group theory. 
Here will only give a simple overview of the results of greatest use in material modeling. 

Similar concepts apply to tensor analysis. If the components of a tensor are unchanged 
upon an orthonormal right-handed change of basis, then the tensor is said to be proper 
isotropic. If the tensor components are also unchanged upon reflections, then the tensor 
is strictly isotropic. In physical applications, there are many instances when reflections 
are not permitted (e.g., in materials modeling, that would entail turning a material inside- 
out, which is not of interest). Any tensor that is strictly isotropic will also be proper isotro- 
pic. Proper-isotropy is a broader property of significant physical interest, so you should 
always characterize proper-isotropy constraints before investigating strict-isotropy. If the 
components of a tensor are unchanged for any rotation of the basis about some given vec- 
tor q, then the tensor is transversely isotropic. 

What is isotropy? 

GOAL: Describe two competing definitions of isotropy and the relative merits of each. 

There are two possible ways to define isotropy. 

(i) Definition 1 : a tensor is sfrz'c£/y-isotropic if its components 
are unchanged upon any orthonormal change in basis 

(ii) Definition 2: a tensor is />roper-isotropic if its components 
are unchanged upon any same-handed change in basis 

Consider a second-order tensor A of class V\ . According to definition #1, this tensor is 
isotropic if 

Strict isotropy: Q ip Q: q A = A (j for any orthogonal matrix [Q] (18.1) 

According to definition number 2, the tensor is proper-isotropic if 
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A u for any proper orthogonal matrix [R] (18.2) 



A proper orthogonal tensor (i.e., an orthogonal tensor with determinate +1 ) is a rotation 
operation. When a tensor is proper-isotropic, we are saying that it "looks the same" no 
matter what orientation you view it from. Stated differently, if you hold yourself fixed, 
then the tensor "looks the same" no matter how much you turn it. For proper-isotropy, 
there is no guarantee that the tensor won't look different if you invert it (i.e., if you switch 
to a left-handed basis). Strict isotropy insists that the tensor must also look the same for 
both rotations and reflections. 

So which definition is more useful? Clearly, strict-isotropy is more restrictive because 
satisfaction of Eq. 18.1 automatically guarantees satisfaction of 18.2, but not vice-versa. 
Which definition is more useful from a practical standpoint? We contend that proper-isot- 
ropy is more meaningful for engineering applications. In the vast majority of physics 
applications, you want to know when something will be unchanged upon a rotation, but 
you don't care what happens upon a (non-physical) reflection. Knowledge of proper-isot- 
ropy (even when strict-isotropy does not hold) is very useful information and should be 
tested first in order to not discount important tensors. Unless otherwise stated, we take the 
term "isotropic" to mean "proper-isotropic." 

As a general rule, to determine the most general form for an isotropic tensor, you 
should consider restrictions placed on the components of a tensor for particular choices of 
the rotation tensor, which will simplify your general analysis for exploring the set of all 
possible rotations. Good "particular" choices for the rotations are 90° rotations about the 
coordinate axes: 



0-10 




1 


1 


5 


1 


1 




-1 



and 



1 








-1 


1 






(18.3) 



The component restrictions arising from these special choices will only give you neces- 
sary conditions for isotropy. However, frequently, these necessary conditions turn out to 
also be sufficient conditions. 

For example, to deduce the most general form for an isotropic vector v , you would 
demand that its components satisfy the equation R jp v = v t or, in matrix form, 



(18.4) 



This must hold for all proper-orthogonal matrices [R] . Consequently, it must hold for any 
of the special cases in Eq. 18.3. Considering the first case, 



^11 ^12 ^13 


v l 




V l 


R 2l R 22 R 23 


V 2 
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v 2 


_°31 ^32 ^33 


V 3_ 




V 3_ 
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v 2 
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V 3_ 




V 3_ 



or 
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- _ 


-v 2 




V l 


v l 
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v 2 


_ V 3_ 




V 3_ 



(18.5) 



With this simple test, we have already learning an important necessary condition for a 
vector to be isotropic. Namely, v 2 must equal -Vj and v 2 must also equal Vj . The only 
way one number can equal another number and the negative of that other number is if both 
numbers are zero. Thus, an isotropic vector would have to be of the form <0, 0, v 3 > . We 
can use this information in a second necessary condition of isotropy where we use the sec- 
ond choice in Eq. 18.3: 
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1 





= 





-1 


V 3_ 




V 3_ 



or 



V 3 
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_ V 3_ 



(18.6) 



This result tells us that v 3 itself must be zero. In other words, a necessary requirement for 
a vector to be isotropic is that the vector's components must all be zero (vectors are bor- 
ing). Now that these two specialized tests have greatly simplified the nature of vectors that 
can be isotropic, it is time to use these necessary conditions in the general equation 18.4. 
Trivially, if a vector is zero, then Eq. 18.4 is satisfied. Thus, the zero vector is the only iso- 
tropic vector. 

Looking now at second-order tensors, note that any linear combination of isotropic 
tensors is itself isotropic. By this we mean if A and B (each of class V%) are isotropic, 
then 



R ip R Jq A pi 



A : 



and 



R ip R jq B Pq 



B v 



and it follows that any linear combination aA + fiB will be isotropic because 



(18.7) 



(18.8) 



Important consequence. Since any linear combination of isotropic tensors (of a 
given class) will itself be isotropic, it follows that the set of isotropic tensors (of that class) 
is a linear subspace. Thus, the zero tensor will always be an isotropic tensor. More impor- 
tantly, if there exist any non-trivial (i.e., nonzero) isotropic tensors, then there must exist a 
basis for the subspace of all isotropic tensors of that type. For example, below we prove 
that a second-order tensor of class V\ is isotropic if and only if it is some multiple of the 
identity tensor. Consequently, the identity tensor itself is a basis for the subspace of isotro- 
pic tensors of class V\ . There's only one base tensor, so this must be a one-dimensional 
space. Projecting an arbitrary tensor onto this space (using the projection techniques cov- 
ered in this document) gives you the isotropic part of that tensor. Interestingly, we will 
find that the dimension of the space of isotropic tensors depends on both the order of the 
tensor and on the dimension of physical space. Given tensors of class V'* t , the space of 
isotropic tensors depends on both m and n . 
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Isotropic second-order tensors in 3D space 

In earlier sections, we introduced the notion of vector and tensor invariants. Ordi- 
narily, vector and tensor components will change upon a change in basis and hence com- 
ponents are numbers, but not scalar invariants. Now we ask what relationships must be 
satisfied if the components themselves are to remain unchanged upon a change of basis. 
Such relationships define isotropic tensors. A vector or tensor is called isotropic if its 
components are the same with respect to any orthonormal basis. Any linear combination 
of isotropic tensors is itself an isotropic tensor. Therefore, the set of all isotropic tensors 
(of a given order) forms a subspace. By this, we mean that there exists a finite number of 
"primitive" isotropic tensors that serve as a basis such that any isotropic tensor may be 
expressed as a linear combination of the primitive isotropic base tensors. 

First we will prove that the only isotropic vector is the zero vector. Referring to Eq. 
(13.11), a vector is isotropic if and only if v k = v k for any coordinate transformation. 
Consequently, we seek conditions on the vector components such that 

v = v ,-£?■■ for all orthogonal Q.. 

or, in matrix form, {v} = [(?]{v} for all orthogonal [Q] (18.9) 

Since this must hold for all orthogonal [Q] , it must also hold for any particular choice for 
an orthogonal [Q] . Choosing 



[Q] 



1 
-10 
1 



(18.10) 



shows that one restriction on the vector components must be v l =v 2 ■ Other choices for the 
orthogonal tensor eventually reveals that not only must the components of the vector all be 
equal, the only way to satisfy Eq. (18.9) is for all of the components to be zero. Hence, the 
only isotropic vector is the zero vector. 

Referring to Eq. (13.14), a second-order tensor in 3D space is isotropic if and only if 

[T] = [ Q][T][Q] T for all orthogonal [Q] (18.11) 

This condition implies that the tensor must be a scalar times the identity tensor /. In 
other words, the most general form for an isotropic tensor referenced to 3D space is 



(18.12) 



where a is an arbitrary scalar. Isotropic tensors in 3D space is therefore one-dimensional 
since only one scalar is needed. The identity tensor / is a basis for this space. Any general 
tensor B may be projected to its isotropic part by the operation 
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isol? 



M:B) 
1:1 



(18.13) 



Note that I:B = txB and /:/ = xtl = 3 . Hence, 
isofi = -(tr B)I 



(18.14) 



This is a very familiar result. The idea of finding the isotropic part by projecting to the 
space of isotropic tensors becomes less obvious when considering tensors in spaces of dif- 
ferent dimensions. 

Isotropic second-order tensors in 2D space 

GOAL: Demonstrate that the proper-isotropic space is two dimensional for tensors of class 
V 2 2 , in stark contrast to the result for V 2 3 . The strict-isotropic space is one-dimensional. 

To consider both proper-isotropy and strict-isotropy of tensors of class V 2 (i.e., ten- 
sors in two-dimensions that can be represented by 2 x 2 matrices), we first need to iden- 
tify the general form for an orthogonal tensor in this space. 



Letg 



a b 
c d 



We seek restrictions on the components (a, b, c, and d) such that 

[Q] T [Q] = [i] 



or 



a c 
b d 


a b 
c d 


= 


1 
1 



(18.15) 



(18.16) 



(18.17) 



Multiplying this out shows that the components must satisfy 

a 2 + c 2 = 1 
b 2 + d 2 = 1 
ab + dc = 

We can satisfy the first two constraints automatically by setting 

a = cosa, c = sina 
b = cosP, d = snip 

Then satisfying the last constraint requires that 
cos a cos p + sin a sin p = 



or 



or 



cos(p- a) = 



(18.18) 

(18.19) 
(18.20) 
(18.21) 
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P = <X±- (18.22) 

Putting this result back into Eq. 18.19 using p = a + - gives 

a = cosa, c = sina 

b = -sina, d = cosa (18.23) 

Putting this result back into Eq. 18.15 yields a proper orthogonal matrix, so we will denote 
it by [R]. Namely, 



[R] = 



cosa -sina 
sina cosa 



(18.24) 



71 



On the other hand, substituting Eq. 18.22 back into Eq. 18.19 using p = a — gives 



a = cosa, c = sina 
b = sina, d = -cosa 



Putting this result back into Eq. 18.15 yields an improper orthogonal matrix, 



[Q] 



cosa sina 
sina -cosa 



(18.25) 



(18.26) 



Equation 18.24 is the most general form for a proper orthogonal matrix in 2D and 18.26 is 
the most general form for an improper matrix. With this result in hand, we are ready to 
explore the nature of isotropic tensors in 2D. For a second order tensor to be proper isotro- 
pic its components must satisfy 



cosa -sina 
sina cosa 



A n A n 

A 2l A 22 



cosa sina 
-sina cosa 



Considering, as a special case, a = - gives 



-1 
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A n A n 

A 2l A 22 ^ 
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-1 
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A n A l2 

A 2l A 22 



or 



A, 



and A, 



-A, 



A n A n 

A 2l A 22 



(18.27) 



(18.28) 



(18.29) 



L U ^l 22 emu rx n si 2l 

Since this result was obtained by considering a special rotation, we only know it a neces- 
sary condition for isotropy. However, substituting this condition back into Eq. 18.27 
shows that it is also a sufficient condition. 

Consequently, the most general form for an isotropic tensor referenced to 2D space is 
of the form 



a b 
-b a 



(18.30) 
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where a and b are arbitrary parameters. Any tensor in 2D space that is of this proper-iso- 
tropic form may be expressed as a linear combination of the following two primitive base 
tensors: 



[/] 



1 
1 



and [s] 



1 
-1 



(18.31) 



Note that s is the 2D version of the permutation symbol; namely, s ■■ is zero if i=j , it is +1 
if (/= 12 , and it is -1 if ij=2l . In two dimensions, the (proper) isotropic part of a second- 
order tensor F would be obtained by projecting the tensor onto the space spanned by the 
basis in Eq. (18.31). This basis is orthogonal, but not normalized, so the appropriate pro- 
jection operation is 

I(I:F) e(e:JP) 

isoF = s s s + ~ 



/:/ 



s:s 



_I(F n +F 22 ) l(F n -F 2l ) 



(18.32) 



In component form, 



isoF 



^11 + ^22 F\2 ^21 



F 



21 



~F\2 F\\ +J ^22 



(18.33) 



Incidentally, the 2D polar rotation tensor associated with any 2D F tensor is proportional 
to isoF. Specifically, 



R 



1 



•^11 + ^22 ^12 ^21 



F. 



21 



"^12 ^11 + -^22 



7(F 11+ F 22 )2 + (F 12 -F 21 )2 

for 2D space only ! . (1 8.34) 

This formula provides a particularly convenient (and barely known) method for finding 
the polar decomposition for 2D problems. 



Recall that proper isotropy is less constraining than strict-isotropy. To be strictly iso- 
tropic, a tensor must first be proper-isotropic, which means it must be of the form 



a b 
-b a 



(18.35) 



This result guarantees that the components of the tensor will be unchanged under a proper 
(same-handed) basis transformation. To be proper isotropic, it must also satisfy transfor- 
mations using the matrix [Q] from Eq. 18.26. Namely 
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(18.36) 



Considering a = shows that b must be zero, which also is easily confirmed to be a suf- 
ficient condition to satisfy Eq. 18.36. Consequently, for strict isotropy, a second-order ten- 
sor in 2D must be a multiple of the identity. That is, the permutation tensor s is proper- 
isotropic, but not strictly isotropic. Its components will change sign upon changing to a 
differently handed basis. In dyadic form, the permutation tensor may be written 



€i!?2 



€2^1 



(18.37) 



Changing to a different-handed basis (i.e., exchanging e x and e 2 ) will automatically 
change the sign of the components. 

Isotropic fourth-order tensors 

Turning our attention back to tensors in 3D space, the most general form for a fourth- 
order isotropic tensor c ijrs is 



«(W + PW + y(8«5,>) 



(18.38) 



ijrs \ ij rs* ~\~irjs' ' v is jr 

For a proof, see, for example, Ref [2]. The above expression has three arbitrary parame- 
ters, so the space of isotropic fourth-order tensors is three-dimensional,* with base tensors 
given by the parentheses above. The basis tensors in the parentheses of Eq. (18.38) are 
only one choice for the basis. In material modelling, a more convenient basis for the space 
of isotropic fourth-order tensors is 



piso = Is x 
r ijkl 2, ij M 



pswdev = kSuSn + SM-h* 



pskew 
r ijkl 



Jl 



jV 3 ij kl 



1 



W-5A) 



(18.39a) 
(18.39b) 
(18.39c) 



Note that these are all constructed from linear combinations of the primitive basis of 
Eq. (18.38). Even though the component formulas for this alternative basis are consider- 
ably more complicated, the properties of this basis are irresistible. Specifically, the basis 
of Eq. (18.39) consists of complementary projector si By this we mean 



piso piso 
r ijkl r klmn 


- piso 
ijmn 


piso psymdev — n piso pskew — n 
• r ijkl r klmn U ' r ijkl r klmn ' U 


(18.40) 














psymdev E>iso 
ijkl klmn 


= o iso , 


Dsymdev Dsymdev = Dsymdev 
ijkl klmn ijmn 


Dsymdev Dskew = Q 
' ijkl klmn 


(18.41) 














pskew piso = 
ijkl Mm n 


0, pffipffitr = 0. 


pskew pskew = pskew 
ijkl klmn ijmn 


(18.42) 

















* The space is two dimensional if one imposes a minor symmetry restriction that c i -^c- irs ^c j - r . 
That's why isotropic elastic materials have only two independent stiffness moduli. 
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Recall that second-order tensors don't really take on any meaning until they act on a 
vector. Likewise, the meaning of a fourth-order tensor should be inferred by operating on 
a second-order tensor. For any tensor B , note that 

Ptkl B kl = \ B kAj ( 18 - 43 ) 

P?Jk7 dev = \( B ij + B Jt ) - \B kl fi tj (18.44) 

P?}k7 B ki = \( B ij- B ji) ( 18 - 45 ) 

Thus, PM t returns the isotropic part of B , PfJ^f dew returns the symmetric-deviatoric part 
of B , and Pfjf™ returns the skew-symmetric part of skew-symmetric part of B . 

Finding the isotropic part of a fourth-order tensor 

GOAL: Reiterate the concept of projections by showing an advanced, higher-order, 
application. 

Fourth-order tensors are of class V\ , but they are also of class V\ x . In other words, 
they may be regarded as 81 -dimensional vectors. The set of isotropic fourth-order engi- 
neering tensors (IFOET) is closed under tensor addition and scalar multiplication. This 
means that any linear combination of IFOET tensors will itself be IFOET. Therefore, the 
set of all IFOET tensors forms a subspace of general fourth-order engineering tensor 
space. 

In the previous section, we showed that any IFOET tensor can be written as a linear 
combination of PMj , PfJ^f Aev , and ^ffe w ■ These three tensors therefore form a basis for 
the set of all IFOET tensors, and the IFOET subspace must be 3-dimensional. This basis is 
orthogonal (e.g., PfikiP^fkY = 0)» but it is not normalized. We can define an orthonormal 
basis for IFOET tensors as 

(18.46a) 
(18.46b) 



piso _ 

njki = 


piso 
r ijkl 


Dsymdev 
psvmdev _ ijkl 

lJkl ~ s 


pskew . 

njki ■ 


pskew 
_ r ijkl 



(18.46c) 

The denominators in this equation are the magnitudes of the tensors in the numerators, 
obtained by taking the square root of the inner product of the tensors with themselves. The 
denominators can be easily remembered because for ordinary second-order engineering 
tensors (class V\ ) isotropic tensors have 1 independent component, symmetric deviatoric 
tensors have 5 independent components, and skew- symmetric tensors have three indepen- 
dent components. 
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If three m -dimensional orthonormal vectors n l , « 2 and n 3 , form a basis for a 3D 
subspace embedded in the m-dimensional (class V^ ) vector space, then any vector x in 
the higher dimensional space can be projected to the 3D subspace by applying the opera- 
tion 

^projected = p*% (18.47) 

where 

P = n l n l + n 2 n 2 + n 3 n 3 (18.48) 

and the "*" denotes the inner product in the V x m space. 

We are interested in finding the IFOET part of a general fourth-order engineering ten- 
sor X ijkl . This is accomplished by projecting that tensor to the IFOET subspace. Using Eq. 
(18.47), this operation is found by 

X ljkl = PjjklpqrsXpqrs (18.49) 

where the components of the sixth-order ( V 3 ) tensor are found by using Eq. (18.46) as the 
orthonormal basis in Eq. (18.48). Namely, 

p = piso piso _|_ ipsymdevpsymdev _|_ ip skew p skew M8 5CH 

ijklpqrs ijkl pqrs c ijkl pqrs -j ijkl pqrs » ' 

A scalar measure of "percent anisotropy" 

GOAL: 

Add this topic 
Transverse isotropy 

A material property is said to be "transversely isotropic" about a given unit vector a if 
the material can be rotated about this vector without changing the material property. If the 
property is a scalar invariant, then by definition it cannot change when the basis is rotated. 
The concept of transverse isotropy becomes increasingly complicated for vector and 
higher order tensor properties. 

In what follows, we often consider a "material orthogonal basis" {p v P 2 ,P 3 } such 
that p 3 = a . This basis will not generally coincide with the "laboratory basis" 
{e v e 2 , e 3 } used in general calculations. Components with respect to the material basis 
are called material components. Components with respect to the laboratory basis are 
called laboratory components. Our goal in what follows is to show the simplified material 
components of transversely isotropic vectors and tensors and then to show how those ten- 
sors may be expressed directly in the laboratory components without having to perform a 
coordinate transformation. 

A vector u is transversely isotropic if and only if its material components are of the 
form 
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{»} 






Un 



in the material basis {p . } 



(18.51) 



In other words, the only vector that remains unchanged when rotated about the material 
symmetry direction q is one that is itself proportional to a . Thus, since a is a unit vector, 
the most general form for a transversely isotropic vector u is 



u 



u 3 q 



(18.52) 



Thus, in the laboratory basis, 



u 



u 3 i 



! 1 



'3 J 



in the laboratory basis { e . } 



(18.53) 



Now consider a general second-order tensor A . To be transversely-isotropic, the 
material components of must be of the form 



[4] 



\ 


- A s 





A s 


A t 











K 



in the material basis {p.} 



(18.54) 



Here, the subscripts "f ' and "a" indicate transverse and axial (relative to the symmetry 
axis), and the subscript "s" indicates shear. If the tensor is symmetric, then it cannot have 
shear terms and its most general form is 



14] 



\ 











A 











\ 



in the material basis {p . } 



(18.55) 



In other words, the tensor must be diagonal in the material basis, with the 1 1 and 22 trans- 
verse components equal. Thus, transverse isotropy means the tensor must be isotropic in 
the transverse plane. In dyadic notation, the above equation may be written 



4 = A t^P\Pl + P 2 Pl) + A aP^ 



(18.56) 



Recall that Eq. (9.24) is true in any orthogonal system; therefore it holds for the material 
coordinate system and Eq. (18.56) can therefore be written 



4 = A t({-P£l) +A aP& 

or, since p, = a 

A = A t {I- qq) + A a qq 



(18.57) 



(18.58) 
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Rearranging a bit gives the most general direct notation form for a transversely isotropic 
second-order tensor. 



A = A t I+ {A a -A t )qq 



(18.59) 



The tremendous advantage of Eq. (18.59) over the matrix representation of Eq. (18.54) is 
that Eq. (18.59) can be computed directly in the laboratory basis without having to per- 
form a coordinate transformation. Namely, in the laboratory basis, 



[4] = A t 



1 
1 
1 



+(4,-4) 



a x a x a l a 2 a^a^ 



a^a 



2"1 



a n a 



2"2 a 2 a 3 



a^a x a 3 a 2 <2 3 a 3 



(18.60) 



Furthermore, the Eq. (18.59) is more useful when the transverse axis is changing dynami- 
cally because Eq. (18.59) can be differentiated with respect to time. 



226 

Copyright is reserved. Individual copies may be made for personal use. No part of this document may be reproduced for profit. 



September 4, 2003 5:24 pm 
Abstract vector/tensor algebra 



"Don't worry about people stealing an idea. 
If it's original, you will have to ram it down 
their throats. " — Howard Aiken 

19. Abstract vector/tensor algebra 

Structures 

GOAL: What are structures, and why use them? Motivate writing down operations in 
purposely abstract, counter-intuitive, notation to ensure that you don't introduce your own 
bias into the analysis. 

On page 2, we cited familiar examples of structures, which we defined loosely to be a 
collection of symbols written down on the page in a carefully prescribed manner and sub- 
ject to immutable assembly and manipulation rules. The notion of structure type also came 
up. Deciding if one thing is of the same type as something else is often subtle. An orange, 
for example might be considered to be of the same type as a lemon (they are both citrus 
fruits). An apple doesn't fall into the citrus category, but apples, lemons, and oranges all 
fall into the broader category of "fruit." When exploring structures, you typically want to 
identify the largest category that will satisfy all of the structure rules (postulates). 

For illustration purposes, let's just "invent" a few new structures. Let's put three 
objects (each of the same type) inside a pyramid and declare that this structure represents a 
a new object of the same type: 




(19.1) 

With structures, you will often want to avoid endowing anything with physical meaning. 
For example, when considering the natural logarithm structure, lnx , you might want to 
replace it with f(x) so that you won't accidentally assert anything that does not follow 
from primitive postulates (e.g., you would be less likely to replace f(x 3 ) by 3/(x) unless 
you had a rule about f that would permit it; working with lnx 3 , you might accidentally 
impose what you know about logarithms to say this equals 3 lnx without really proving 
it). Writing an operation into a new, unfamiliar, notation is an important step towards dis- 
covering if other operations might obey identical structure rules. If so, anything you prove 
about the first operation will automatically be true for the other structure. 

In addition to our triangle structure, let's suppose that we also have other structures 
with equally odd-looking notation (we will call them the lower and upper box structures) 

r | s and p I q (19-2) 
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Again, we will require that these structures represent objects of the same "type" as the 
individual parts (e.g., if r and s are fruits, then r \ s is a fruit too — perhaps the result of 
cross breeding). Without ever defining what the structures mean, we could start asserting 
"rules of behavior" (postulates taken to be true without question). For example, we could 
demand that the upper and lower box structures must satisfy a commutivity property: 



and 



p q = q p 



(19.3) 



Incidentally, a method for deciding equality of two objects of the same type is presumed to 
exist by postulate (apples and oranges are both of the same type, but they aren't equal if 
our criterion for equality is color of the skin; by this criterion, a navel orange equals a 
Valencia orange equals a tangerine). 

As we did with the triangle, we will demand (by postulate) that the structures in 
Eq. (19.2) result in something of the same type as the individual parts. With this assertion, 
we can state (theorem, not postulate) that the superstructure 





(19.4) 

is well defined as long as all of the parts are of the same type. We have purposefully 
avoided assigning meaning to these structures. Manipulating structures is an essential 
aspect of abstract mathematics — the goal is to define syntax (structure construction and 
manipulation rules), and see what sorts of conclusions (theorems) can be inferred without 
biasing ourselves by inserting what we know to be true based on the meanings of the struc- 
tures. Mathematicians seek to understand what truths follow strictly from the primitive 
structure rules. A new primitive postulate is introduced only if the mathematicians become 
convinced that a certain desired property cannot be obtained from the already existing 
primitives. For example, they might be forced to assert (immutable postulate) that 








(19.5) 

Casting everything into abstract structural form permits mathematicians to eventually 
draw connections between seemingly unrelated operations. Suppose, for example we were 
to investigate whether or not our triangle operation in Eq. (19.1) might represent partial 
differentiation so that Eq. (19.1) means the same thing as the partial of a with respect to b 
holding c constant: 



da 
8b 



(19.6) 
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To decide if this particular structure could be equivalenced with the "triangle" structure, 

we would need to further assign meaning to the two operations in Eq. (19.2). If we let 

these operations represent multiplication and addition, respectively, then Eq. (19.2) would 

become 

rs and P + 1 ( 1 9- 7 ) 

From here, we can no longer arbitrarily endow further meanings to the structures — we 
must follow through and check if the other primitive postulates are satisfied. With these 
interpretations of the operations, we see that Eq. (19.3) is satisfied because 

rs = sr axv&p + q = q+p (19.8) 

Furthermore, Eq. (19.5) would become 

da\ (dd\ (dr\ ^fda] (8s^ „ nnN 

4^^1^/^Ih' (19 - 9) 

This is the chain rule of partial differentiation, which we know to be true from direct study 
of differentiation. Assuming that the structure rules specified above form the complete set 
of primitive postulates, then any superstructures or conclusions that the mathematicians 
obtained in the abstract setting we could immediately know to be true for our specific 
interpretation of the triangle structure. We would not have to go through the effort to prove 
that the triangle and box structure theorems hold for partial derivatives because the mathe- 
maticians have already done the proofs for us — all we had to do was prove that partial 
differentiation, multiplication, and addition are suitable specific instances of triangle and 
box structures. Then we get to benefit from the (underpaid) sweat of mathematicians to 
instantly obtain a new set of truths. In the next section, a less contrived instance of this 
mindset is covered where we look at the mathematicians' structural definition of a vector 
and then verify that our low-brow engineering vectors are particular instances of their gen- 
eral vector structures. 



* The fancy phrase is "isomorphism." Two structures are isomorphic to each other if their structure 
rules are identical. In this case, we want to determine if partial derivative notation is isomorphic to 
triangle structure notation. If so, then any theorems derived using only the structure rules for one 
system will also apply to the other structure. 
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Definition of an abstract vector 

Mathematicians define vectors as being "members of a vector space." A vector space 
consists of certain basic components: 

A1 . A field R must exist. (For this book, the field is the set of reals; for an excellent 
definition of the term "field", see Ref [30].) We will here refer to a member of a 
field as a scalar. * 

A2. There must be a discerning definition of membership in a set V. 

A3. There must be an operation /(a, y) that improved closed in V . In other words, if 
a e R and ye K then axiom A2 must be used to prove that /(a, y) e V . Simi- 
larly, there must be an operation f\\, a) that is also closed in V for every 
a e R and vgF. 

A4. There must be a second operation g(y, w) that is proved closed in V: 
If y 6 V and w e V then g(y, w) e F 

A5. There must be a well defined process for determining whether two members of 
V are equal. 

A6. The / and g functions must satisfy the following rules: 

g(Y> w) = g(w, y) and /(a, y) = /*(y, a) 

g(U,g(Y,w)) = g(g(u,y), w) 

There must exist a special Z e V such that g(y, Z) = y . 

The above axioms are purposefully stated using abstract notation to ensure that they are 
each verified carefully without introducing accidental bias in your analyses stemming 
from what you "know" about the physical meanings of the operators. After you carefully 
verify that the above axioms are satisfied, only then are you allowed to refer to members 
of V as vectors — don't use this term until you know that all axioms are satisfied. Once 
all axioms are confirmed, you can with good conscience declare your right to replace the 
abstract operators f,f*, and g with the standard structures for scalar multiplication and 
vector addition. Namely, 

/(a, y) can be replaced with the structure ay (19.10) 

f\\, a) can be replaced with the structure ya (19.11) 

g(Y> w) can be replaced with the structure y + w (19.12) 

The special vector Z can now be denoted by . (19.13) 



* Using "scalar" as a synonym for "number" is not strictly correct. In continuum mechanics, a scalar 
is a number that is unaffected by superposition of a rigid rotation, which is subtly different from an 
orthogonal change of basis. The trace of the deformation gradient tensor is not a scalar because its 
value changes when there is superimposed rotation. By contrast, the trace of the deformation gradi- 
ent tensor does not change when you change the basis (it's an invariant). 
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You should avoid stating the vector space axioms using these structures from the outset 
because it would be "bad citizenship" to use those structures until you finish verifying that 
all the axioms are true. Of course, once the axioms are all known to be true, the conditions 
of the last axiom can be recast in using familiar addition and multiplication structures as 

y + w = w + y and ay = ya 

\? + (Y + w) = (u + y) + w 

There must exist a zero vector e V such that y + = y . 

If we had written the last axiom like this from the outset, it would have looked "obvi- 
ously" true to you — but that would have been your bias creeping in prematurely. First 
you have to prove that the g operation satisfies the rules of addition before you are permit- 
ted to denote the operation with the plus sign. 
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What does this mathematician's definition of a vector have to do with 
the definition used in applied mechanics? Unfortunately, textbooks seem to 
fixate on item A6, completely neglecting the far more subtle and difficult items A2, A3, 
A4, and A5. Engineering vectors are more than something with length and direction. They 
are also more than simply an array of three numbers. When people define vectors accord- 
ing to the way their components change upon a change of basis, they are implicitly 
addressing axiom A2. In general, axiom A2 is the most difficult axiom to satisfy when 
discussing specific vector spaces. Verifying axiom A2 demands introducing rather awk- 
ward specialized tests that apply to particular sets. To go through the axiom list for ordi- 
nary engineering vectors, the process might go like this: 

A1 . A field R must exist: real numbers. 

A2. Discerning definition of membership in a set V: A member of Fwill be defined to be an array of three num- 
bers { V] , V9, Vn } defined with respect to a set of mutually perpendicular reference directions (assumed 
by postulate to exist). Furthermore, to be a member of V, the three numbers must change in a particular way 
if the reference directions are changed to some other mutually perpendicular directions. The new numbers 
Vi, V9, V-j } where v| = Q jk v t and \J;h_ is the cosine of the angle between the I old 
direction and the k new direction. 

A3. This axiom requires definition of the operations /'(a, y) and / *(y, a) . Anticipating the properties these 
functions must satisfy, we define them to be ordinary scalar multiplication of a three-component array. If 
y e V , then our discerning definition of membership in V tells us that we must have an array {v,, v 2 , v,} 
and we will declare that, regardless of the choice of reference directions, both /(a, y) and f\\, a) will be 
computed by { avj, av 2 , av, } . So far, we have only defined the operations, but the axiom requires us to 
prove that the result will be a member of V. That's where the component transformation rule aspect of the 
"discerning definition of membership" comes into play again. Since ye V , we know that v| = 2;t v ; an d 
we can just multiply both sides of this by a to assert that /(a, y) will satisfy the same transformation 
behavior. Hence, /(a, y) e V. 

A4. This axiom requires definition of a second operation g(\, w) . If y e V and w e V , then we know they 
have component arrays, and we will define g-(y, w) to have a components w, + v, . Given that y and w 
are, by premise members of V, then their conformance to the component transformation rule ensures con- 
formance of g(\, w) , proving that it that this operation is closed in V: 

A5. There must be a well defined process for determining whether two members of Fare equal. If y e V and 
w e V , then we will say they are equal if and only their respective components are equal. 

A6. The / and g functions defined above are readily seen to satisfy the rules 
&(Y> w) = g(yy, y) and /(a, y) = / (y, a) 
g(«.g(Y.w)) = g(g(«» y). w) 

The "special" Z s V will be declared to be {0,0,0}, from which it readily follows that 
g(Y>?) = Y- 

This concludes the outline of proving that ordinary engineering vectors really are vectors 
in the sense that mathematicians use the word. Now that we know that, we can immedi- 
ately make use of any theorems that mathematicians have already derived for general vec- 
tor spaces. For example, using the primitive axioms, you can prove that the zero vector is 
unique, and you can define subtraction of vectors. The vector space definitions make no 
reference to anything like a dot product, so we can't have access to mathematicians' theo- 
rems about angles between vectors or lengths of vectors. To do that, we need to add two 
more axioms as described below. 



and they are failing to also address the other axioms ! 
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Many applied mechanics textbooks focus to distraction on proving that every new 
operation satisfies transformation rules. However, by recognizing that engineering vectors 
are special instances of abstract (mathematician's) vectors, you don't usually have to do 
that. Instead, you can assert that various operations used in engineering are special cases 
of operations already studied by mathematicians for general vector spaces. The mathema- 
ticians have already proved that these operations produce vectors, so why should we 
bother doing the same? 

Inner product spaces 

An inner product (here denoted (a, b)) is a scalar-valued binary* operation between 
two vectors, a and b , that must satisfy the following rules: 

A7. (a, b) = (b, a) 

A8. (a, a) > if a * and (a, a) = only if a = . 

An inner product space is just a vector space that has an inner product. 

Alternative inner product structures. Once you have verified that these axioms 
are satisfied, then you are free to replace the notation structure (a, b) with some other 
structure of your own invention (or one that is commonly employed by your colleagues) 
and you will be justified in stating that the structure represents an inner product. In this 
document, we adopted the structure a • b to denote the inner product between two vectors 
of class V\ and we used the structure A:B to denote the inner product between second 
order tensors of class V\ . Recognizing the limitations of these structure conventions for 
higher-order tensors (e.g., it would be ridiculous to stack up six dots to denote the inner 
product between sixth-order tensors), we also described the alternative notation A ®B for 
the inner product between tensors of class V¥ . You might also see the structure A®B to 
denote the same thing. ' Some people use A ■ B to denote the inner product and AB to 
denote tensor contraction; we can't use that notation because it would violate self-consis- 
tency rules that we have introduced in this book (namely, we use A ■ B for tensor contrac- 
tion and AB for dyadic tensor multiplication). When people choose different structures to 
denote the same operation, don't be annoyed. They probably have good reasons for their 
choices. 



* The term "binary" is just an obnoxiously fancy way of saying that the function has two arguments. 

t Some people use A ■ B to denote the inner product (regardless of the order of the operands) and AB 
to denote tensor contraction; we can't use that notation because it would violate self-consistency 
rules that we have introduced in this book (namely, we use A ■ B for tensor contraction so we can't 
permit this structure to be an alternative representation for the totally different inner product opera- 
tion. Likewise this book's tensor nomenclature has already said that AB stands for dyadic tensor 
multiplication so we can't let it also stand for tensor contraction). Issues like these make it essential 
for you to leam the local tensor structures (notation conventions) used by each individual author in 
each individual publication. Sorry, but that's how it goes in this field. 
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By the way, that we also introduced in this document the structure A"B whose value 
is computed in Rectangular Cartesian Systems (RCS) by A^B^ . We did not however refer 
to this scalar valued operation as an "inner product" because the operation fails the posi- 
tivity axiom A8. Good citizenship demands that the phrase "inner product" should be con- 
sidered hallowed ground for the mathematicians — don't use this term unless your 
operation satisfies the required axioms. 

Some examples of inner product spaces. Ordinary engineering vectors form an 
inner product space. First of all, engineering vectors are proved to be vectors in the first 
place by postulating the existence of some mutually agreed upon reference set of direc- 
tions (usually orthonormal, such as the edges forming between the floor and walls of the 
laboratory), and all directional quantities are described in terms of multiples of these pos- 
tulated "lab" directions (i.e., vector components). To formally verify the axioms for vec- 
tors, the vector transformation rule governing how components must change upon a 
change in basis) is used as the "discerning definition" and ordinary array addition and sca- 
lar multiplication are used for the / and g functions. With these awkward rules, it can be 
proved that engineering vectors are indeed vectors. 

For engineering vectors, the inner product is computed by 

(a, b) s a • b = a l b l + a 2 b 2 + a 3 b 3 = a k b k (19.14) 

The vector transformation rule ensures that you will get the same result from this opera- 
tion no matter what basis you use. Even though the individual components of vectors will 
change upon a change of basis, the above combination of components will come out the 
same. 

For second-order engineering tensors, the inner product is 

{A,B)=A:B = A U B U (19.15) 

The choice of inner product is not unique. For many engineering applications, it is often 
convenient to define an alternative energy-based inner product that uses a symmetric pos- 
itive definite weighting tensor W\ 

(a,b) = \%»W»b (19.16) 

Note that it is essential that W be symmetric in order to satisfy A7 and positive definite to 
satisfy A8. 

The word "energy" is an apt descriptor for this type of inner product. For continuum 
elasticity problems, a material having a strain s and a stress rj has an internal energy 
given by 

u = l -s:E:s, (19.17) 

where E is the fourth-order elastic stiffness tensor. Thus, E plays a weighting role much 
like the tensor W in Eq. (19.16). 
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Continuous functions are vectors! 

Many seemingly unrelated things can be shown to be vectors by the above abstract, 
axiom-based, definition. Consider, for example, the following "discerning definition" for 
a set: Fis the set of real continuous functions. Applying the above axioms shows that this 
is a vector space. Furthermore, if/ and g are two continuous functions, then their inner 
product may be defined as 

f*g = \f(x)g(x)dx (19.18) 

— 00 

Note the similar structures: In (19.14), there is a summation over the dummy subscript, k. 
In (19.18), there is an integration over the dummy argument, x. 

Once something is discovered to be an inner product vector space, a whole wealth of 
already-proved theorems becomes available. For example, the angle between two ordinary 
engineering vectors is defined by 

cose = — 1 * ~ - (19.19) 

J a • a 7b • b 

We could likewise use Eq. (19.18) to define the "angle" between two continuous func- 
tions. Recall that the dyad between two ordinary vectors « and b is defined to be a new 
object such that (a ® b) • v = q{b • v) for all vectors v . Likewise, you can define a 
"dyad" between two real continuous functions f and g to be a new object such that 

(f®g)»h =f(g*h) (19.20) 

Recall that a dyad q <8> b is a rudimentary tensor — i.e., a new object that needs two indi- 
ces to describe it so that its indicial expression is a t b- . Likewise, the dyad between contin- 
uous functions is interpreted as a special kind of new object: a function of two variables 
(AKA binary function). Equation (19.20) tells us that (f® g)(x,y) = f(x)g(y) . Recall 
that dyads were just special kinds of second-order tensors. Likewise f® g is a special 
kind of function of two variables — separable. Recall that the vector equation z = W • v 
is written in indicial form as 

3 
z, = £ W ijVj (19.21) 

7=1 

Analogously, given continuous functions z(x), v(y) , and a binary function W{x,y) the 
operation z = W • v would be interpreted as 



z(x) = \ W(x,y)v(y)dy (19.22) 
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Once you recognize this parallel structure between continuous functions and ordinary 
engineering vectors, you will find that reading advanced calculus textbooks becomes a lot 
easier. You will see that you already know many of the things that those books teach. The 
major distinction is that ordinary engineering vectors belong to finite-dimensional spaces 
(they only need 3 base vectors) whereas the space of continuous functions is infinite 
dimensional. As with ordinary vectors, you can define a basis for continuous functions, 
but the basis contains an infinite number of members. For example, a Taylor series is an 
expansion of a continuous function in terms of the power basis { 1, x, x 2 , . . . } . A Fourier 
series is an expansion in terms a different (trigonometric) basis. 

Tensors are vectors! 

For applications in advanced continuum mechanics, it is extremely useful to recognize 
that second-order tensors form a nine-dimensional inner-product vector space. Using the 
rules for scalar multiplication and tensor addition, one can readily verify that the axioms 
Al through A6 are satisfied by tensors. The inner product between two tensors is defined 
in Eq. (12.1) as 

A.'B^AyBy (19.23) 

which satisfies the inner product axioms, A7 and A8. This definition of the tensor inner 
product sums pairwise over all components just like Eq. (19.14). By pairwise, we mean 
that, for example, A l2 is multiplied by B v , not by B 2l . 

There are an infinite number of ways to generate a scalar from a binary operation between 
two tensors. For example, some authors wrongly refer to A»*B = tr(4 • B) = A-B-j as 
an inner product. However, this operation is not an inner product because it fails the posi- 
tivity axiom A8. Specifically, consider 



[4] = 4 2 0- ( 19 - 24 ) 



1 


-3 





4 


2 











1 



Then 

A: A = A n A n +A l2 A l2 + ... + A 33 A 33 = 1 + 9 + 16 + 4 + 1 = 31 > (19.25) 

but 

A«A = A n A n +A l2 A 2l + ... +^ 33 ^ 33 = 1-12-12 + 4 + 1 = -18 <0, (19.26) 
which proves A"B is not acceptable as an inner product. 
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Both A: A and A" A are scalar invariants of the tensor A. Note that 
A"A = tr(A 2 ) , which may be written in terms of the characteristic invariants as 
l\-2I 2 - For symmetric tensors, it turns out that A"A = A: A. However, for nonsym- 
metric tensors, the inner product invariant A: A is not generally expressible as a function 
of the characteristic invariants, and it is therefore a fourth independent invariant. To prove 
this last statement, consider 



[A] = 0, 09.27) 






a 
























where a is an arbitrary scalar. The characteristic invariants of this tensor are all equal to 
zero. However, the inner product invariant is A: A. = a 2 , which can take on different val- 
ues, depending on the value of a . It therefore must not be expressible as a function 
/(/j, I 2 , 1-x) , of the characteristic invariants. It is a fourth, wholly independent, invariant. 

Vector subspaces 

Consider a set S that is a proper subset of a vector set V . The set S is called a "sub- 
space" if any linear combination of members of S is itself in S . A subspace S is itself a 
vector space because all of the vector space axioms that were proved for the larger vector 
set V continue to hold for set S . Proving that something is a subspace really only requires 
proving axioms A3 and A4 with axiom A2 replaced by the more restrictive discerning def- 
inition for membership in the subspace S . 

Again, a subspace is itself a vector space. It is generally of lower dimension than V . In 
ordinary 3D space, a subspace is like a plane — any linear combination of vectors in a 
plane is itself in the plane. By contrast, consider the set of all unit vectors is not a subspace 
because a linear combination of two unit vectors is not itself a unit vector. Recalling that 
second-order tensors are themselves nine-dimensional vectors, we encounter tensor sub- 
spaces as well. The set of all symmetric second-order tensors is a tensor subspace because 
any linear combination of symmetric tensors is itself a symmetric tensor. The set of all 
orthogonal tensors is not a tensor subspace because a linear combination of orthogonal 
tensors is not itself orthogonal. The set of all transversely isotropic tensors is not a sub- 
space, but the set (which we will denote TI a ) consisting of all tensors that are transversely 
isotropic about a particular (fixed) direction q does form a subspace. Specifically, refer- 
ring to Eq. (18.59) we note that the tensors, / qq , and — s • q form a basis for TI a . This 
basis, is not however, orthogonal because /:(««) * . Referring instead to Eq. (18.58), we 
could alternatively define 



f, 


= I-qq 


h 


= qq 


^3 


= -s • q 



(19.28) 
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These tensors form an orthogonal basis for TI a . The basis is orthogonal because 
B :B . = if i ^ / . However, 

B l :B l = 2 B 2 :B 2 = 1 B 3 :B 3 = 2 (19.29) 

Hence, this basis is orthogonal, but not normalized. We could naturally divide B by J2 
to normalize it, but doing so would make it no longer a projection. Normalizing the basis 
would be wise if our applications frequently required the tensor inner product of trans- 
versely isotropic tensors. Most engineering applications require just the single dot (com- 
position) product between two transversely isotropic tensors, in which case leaving the 
basis as projectors is more convenient to utilize the fact that B • B = B . Incidentally, 
B is also a projector, but B is not. 

Example: Let c be a fixed vector. Let S denote the set of all vectors x for which 
c • x = .Is S a linear subspace? The answer is "yes" because any linear combination of 
members of S will itself belong to S . To see why, let x { and x 2 belong to S then, by def- 
inition of membership, we know 

c»x l = and c»x 2 = (19.30) 

Now consider a linear combination of these two vectors, a^x^ + a 2 x 2 ■ Does this linear 
combination belong to 5*? The answer is "yes" if and only if 

c • (a l x l + a 2 x 2 ) = (19.31) 

Expanding this out using Eq. 19.30 shows that equality does hold. Therefore S is a sub- 
space. 

Example: commuting space. Let C denote a fixed symmetric tensor. Let S denote 
the set of all tensors X, both symmetric and non-symmetric, that commute with C . By 
this we mean 

X belongs to S if and only if C»X = X»C (19.32) 

To prove that this is a linear subspace, you must prove that 

C • (a l X l + a 2 X) = (a l X { + a 2 X) • C 

for all tensors X and X belonging to S (19.33) 

Multiplying this out, using the fact that Eq. 19.32 applies for X and X shows that this 
equation is true for the linear combination as well. Hence, S is a linear subspace. 

The far more interesting questions are: How do you characterize members of S more 
explicitly and what is the dimension of 5*? To answer, let's write out the membership crite- 
rion in terms of the principal basis for C in which case, the matrix form of Eq. (19.32) 
becomes 
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c l X n c x X n c l X n 

C nA') i C iA^ C o-^i 9 1 
C 3^31 C 3^32 C 3^33 



CjX n c 2 X 12 c 3 X l3 
CjX 21 c 2 X 22 c 3 X 23 

C 1^31 C 2^32 C 3^33 



(19.34) 



The diagonal components are automatically satisfied for any tensor X . The off-diagonal 
components require 



(c l -c 2 )X n = 



(c 2 -c l )X : 



21 



(c 2 -c 3 )X : 



23 







, etc. 



(19.35) 



(19.36) 



(19.37) 



If all of the eigenvalues of C are distinct, then these off-diagonal constraints require that 
the off-diagonals of X with respect to the principal basic for C must all be zero — in 
other words, the set S is the set of all tensors with the same principal basis as C and the 
dimension of this space is three (you only need to specify three eigenvalues to identify any 
member of S). When C has distinct eigenvalues, the basis for its commuting space con- 
sists of simply the three eigenprojectors for C; namely, 



P\P\ i PoP 



il-Cl 



2^2 



P 3 P 3 when c l ^c 2 , 



c 2 * c 3 , 



and 



c 3* c l 



(19.38) 



If, on the other hand, C has only two distinct eigenvalues, then exactly two of the off- 
diagonals of X become unconstrained. If, for example, c x = c 2 ^c 3 , then Eqs. (19.35) 
and (19.36) are automatically satisfied and the most general form for a member of the 
commuting space will have components with respect to the principal basis of C of the 
form 



~*11 


x u 





x 2l 


^22 











*33 



(19.39) 



If X is symmetric, note that the upper 2x2 matrix can be symmetrized, and the resulting 
principal basis for X will also be a principal basis for C because any two vectors in the 
1-2 plane will be eigenvectors of C . Thus, whenever a symmetric tensor X commutes 
with C , a commonly shared principal basis can always be found for the two tensors. This 
does not mean that the commuting space S is again reduced to three dimensions. To the 
contrary, the shared basis will be different for a different X* in S. When C has 



c 2 ^c 3 , the basis for the commuting space is 

PlPl ' PlPl ' ^3^3 ' P\P,2 ' PlP\ When C l 



C 2* C 3 



(19.40) 



Finally, when C has a triple eigenvalue, then it must be proportional to the identity, and 
therefore any tensor will commute with C . In this case, the commuting space is the 
entirety of tensor space itself, which is nine-dimensional. 
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Commuting tensors can be considered in a more direct notation context. The charac- 
teristic space associated with an eigenvalue is the span of all eigenvectors associated 
with that eigenvalue. The "commutation theorem" [24] states that, if C • X = X* C , then 
if v belongs to a characteristic space of C , then X* v also belongs to that same character- 
istic space. This does not imply that v is necessarily an eigenvector of X, but it can be 
used to prove that there does exist at least on principal triad that is shared by C and X . 

Subspaces and the projection theorem 

Whenever a subspace S is discovered, it is almost always wise to identify the opera- 
tion that will project vectors in V into parts that are in S and orthogonal to S . Many seem- 
ingly unrelated theorems are all in fact applications of the projection theorem. Consider, 
for example, the set of all even continuous functions — i.e., they have the property 
f(-x) = f(x) . This set is subspace because any linear combination of even functions will 
also be even. A famous theorem states that any function can be written as the sum of an 
even plus an odd function. This theorem is an application of the projection theorem. Note 
that odd functions are orthogonal to even functions because the integral in Eq. (19.18) will 
be zero if / is even and g is odd. 

The set of all matrices that have a zero trace is a subspace (because any linear combi- 
nation of "traceless" tensors will itself be traceless). An oft-used theorem states that any 
matrix can be written as the sum of its isotropic and deviatoric (traceless) parts. This is the 
projection theorem again. Likewise any matrix can be written as the sum of its symmetric 
plus antisymmetric parts. This is the projection theorem. 

Abstract contraction and swap (exchange) operators* 

Virtually all operations in tensor algebra can be written using a rather arcane — but 
nevertheless conceptually useful — generalized notation in which the arguments are first 
multiplied dyadically and then operated on by either contraction or swap operators, as 
defined below. These operators are almost never mentioned explicitly in practice, but it is 
often useful to visualize simpler operations in terms of contractions and swaps in order to 
determine properties of the operations. 

Any vector v is expressible as components v i times base vectors g-. Any second- 
order tensor T is expressible as components T t - times base dyads e t e- . In general, any 
jV* -order tensor may be expressed as a sum of components (having a total of N indices) 
times N dyadically multiplied base vectors. 



This section is rather mathematical and it may be skipped without loss in continuity. 
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The contraction operator Cj is defined to dot the X th base vector with the J* base 
vector. Here, I and J are not tensor indices — they merely indicate the positional loca- 
tion of a dyadically multiplied base vectors. The contraction operation is well-defined 
only when operating on second- and higher-order tensors. For example 

C}(ab) = C^ia^bfe-e,) = ah^e. • e. = a ,Z>,-8 ■■ = a.-b,- = « • b 

dot 
CKT) = CHT^ej) = T l} e^e r T^ = T u = trJ 

dot 



dot 
C?(p) = Cl^e^eJ = p iyit (g. • e k )ej = ^ 

clot 

C A 2 (h) = C^H^e^e.eJ = H iJkl (ej • eje^ = H ijkj e t e k (19.41) 

KJ 

dot 

The contraction operator reduces the order of the operand by two. If, for example, the 
operand is a second-order tensor, then the result is a zero-order tensor, which is a scalar. 
As seen above, the contraction of a third-order tensor gives a first-order tensor, which is a 
vector. The contraction of a fourth-order tensor is a second-order tensor. 

The generalized operator Cj\ dots the X th base vector with the J th vector and the 
fC th base vector with the X th vector. This operation reduces the order by four. To be well 
defined, all four of the indices, I, J, K, and L, must have distinct values. The operator 
is well-defined for tensors of fourth-and higher order. For example, 

Cm ) = Cim jk m^l) = H ijkl {e t . ejiej . e k ) = H ikki (19.42) 

Incidentally, note that Cf%( ) is not the same thing as C\{C\{ )) . In particular, 

C\](H) = C\{Cf{H)) = C\{Cj{H)). (19.43) 

Higher order contraction operators such as Cj^m are similarly defined. 
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The swap (or "exchange") operator Xj is defined to swap the I th base vector with 
the J* h vector. This operation does not affect the order of the operand. The swap operator 
is well-defined only when operating on second- and higher-order tensors. For example 

X\{T) = XftT tm ) = T im = TJ 

V7 
swap 

\} 

swap 



v * 
swap 

The generalized swap operator Xj% swaps the I th base vector with the J* h vector and 
the K th base vector with the L th vector. To be well defined, all four of the indices, 
I, J, K, and L, must have distinct values. The operator is well-defined for tensors of 
fourth-and higher order. For example, 

swap 

x niw = x ti( H ijM^j^i) = H iju e ~m e ~i ( 19 - 45 ) 

swap 
Higher order swap operators such as X^^ are similarly defined. 

The contraction operator and the swap operator are almost never mentioned explicitly 
in publications but they are nonetheless very useful in generating theorems because they 
are both linear operations. Namely, 

C J T (aA +B) = aC J T {A) + Cj{B) for all scalars a 

and for all tensors A and B of arbitrary (but equal) order ( > 2 ). (1 9.46) 

X J T (aA +B) = aXj(A) +Xj{B) for all scalars a 

and for all tensors A and B of arbitrary (but equal) order. (19.47) 

The last property is particularly useful for performing integrals of quantities that differ 
from each other only in the ordering of their indices. Noting that any permutation of indi- 
ces may be obtained through a sequence of swap operations, we recognize that only one of 
our integrals need be computed. Linearity of the swap operation allows us to immediately 
write down the solution for all of the integrals once we have found the solution for the first 
one. 

At the beginning of this section, we mentioned that most tensor operations may be 
written as a sequence of either swap or contraction operations acting on dyadically multi- 
plied operands. For example 

A*x = Cl(A®x) = Cf(x®A) = Clix^XliA)) (19.48) 
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and 

kxv = CfffsKvJ (19.49) 

In the above equation, s is the permutation tensor given by e j/k e i e-e k , where s ik is the 
permutation symbol defined in Eq. (3.76). The operand say is a fifth order tensor having 
ijklm components given by s i - k u l v m . The contraction*operator C^f reduces the order 
from five down to one by contracting the 2nd index with the 4th index and the 3rd index 
with the 5th index to obtain s i - k u-v k , which is indeed the indicial expression for the z th 
component of u x y . It may appear that we have taken a fairly simple operation (the cross 
product) and written it in an insanely complicated manner. 

Keep in mind: we are not advocating the use of the contraction and swap operations in 
published analyses. We merely want to drive home the point that virtually all tensor oper- 
ations can be expressed using contraction and swap operators. Contractions and swaps are 
particularly useful when applied to tensor-integral calculus. Specifically, suppose that 
f{x) denotes some n th -order tensor valued function of a vector x . If C and X denote any 
contraction and swap operation applicable to f(x) , then 

C\\\f(x)dV = \\\C[f(x)]dV (19.50) 

x\\\f(x)dV = \\\X[f(x)]dV (19.51) 

In other words, contraction and swap operations commute with integration. This means 
that the best context in which to derive new theorems is to do it for dyadically multiplied 
operands whenever possible. From this generalized context, a host of new theorems "fall 
out" as corollaries. For example, a very general form of the Gauss-Ostrogradski theorem 
states that the integral over a closed surface of the outward normal n multiplied dyadi- 
cally by a tensor of arbitrary order can be transformed to the volume integral of the gradi- 
ent of that tensor. 

jjn( )dA = j*j*j*V( )dV (19.52) 

Here, the notation n{ ) denotes the outward unit normal n to the integration surface 
multiplied some quantity ( ) of arbitrary tensor order, and V( ) denotes the gradient of 
that tensor. 

Because the contraction operation commutes with integration, one can immediately 
write down the classic "divergence" theorem by taking the C\ contraction of both sides of 
Eq. (19.52) to obtain 

]"]"«•( )d4=JJJv«( )dV (19.53) 

Another corollary is obtained by inserting the cross product into Eq. (19.52), which we 
know we can do because we know that a cross product is expressible in terms of contrac- 
tions (which in turn commute with integration). Thus, 
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\\nx( )dA = fffVx( )dV (19.54) 

Incidentally, despite the presence of the cross product, this theorem is not equivalent to 
Stokes theorem. 

Consider a particular indicial form of Eq. (19.52) in which the operand is a second- 
order tensor: 

\\n lTjk dA = \\\^T jk dV (19.55) 

The swap operator X^ is linear and therefore commutes with integration. Thus, in 
addition to the above equation, we also have an immediate set of corollaries in which the 
indices in the above equation may be arbitrarily permuted. Likewise, the contraction oper- 
ator C j is linear and may be commuted with integration. Thus, any of the indices in the 
above equation may be contracted. 

The contraction tensor. Since the contraction operator C\(T) is linear, we know 
from Eq. (9.7) that there must exist a second-order tensor C such that 

C\{T) = C:T = C^j (19.56) 

We know from Eq. (19.41) that 

C\{G) = trJ = T kk = b y T tj (19.57) 

Comparing the above two equations, we note that C is simply the identity tensor. Hence, 
the contraction operation can be viewed as the identity tensor double dotted into two spec- 
ified base vectors. This point of view is useful when considering differentiation. The iden- 
tity is a constant tensor and its derivative is therefore zero. It is often useful conceptually 
utilize the contraction in gradient identities. For example, 

V »n> = L'Vw (19.58) 

The contraction is extremely useful in integration identities. For example 

j" V • wdV = \l:(Vw)dV = I:\VwdV (19.59) 

These formulas show that knowing the complete gradient tensor Viv is really the most 
useful. You can just take the trace of this total gradient tensor to immediately obtain the 
divergence. Likewise, you can take the (negative) axial part of the total gradient tensor to 
obtain the curl: 

-axial Vw = £:Vw> = V x w (19.60) 



The swap tensor. Recall from Eq. (19.44) that the effect of the swap operation on a 
second-order tensor T is to simply produce the transpose of that tensor: 
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X\(T) = T T (19.61) 

This is a linear operation transforming a tensor T into a new tensor T T . Therefore, this 
simple operation must be expressible in terms of a fourth-order swap tensor X such that 

T T = X:T (19.62) 

Writing this out in indicial notation reveals that 



i = SfcSy.S/Sjfi.S* (19.63) 

This tensor can be regarded as the fourth-order transpose operator. Note that it is the same 
as the fourth-order identity tensor except the last two base vectors are swapped (or, equiv- 
alently, the last two indices in the indicial expression are swapped). 
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20. Vector and Tensor Visualization 

Suppose you are given a 2D scalar field (i.e., scalars that vary in space in a known 
manner). For example, the altitude of a mountain could be regarded as a scalar that varies 
over a 2D space. Then some conventional ways to visually display this altitude is with a 
contour map, a 3D elevation, and a color density map. If, for example, the altitude of the 
mountain, z, is given by 

z = 1 + sin(xy) (20.1) 

then these three strategies would yield the plots shown in Fig. 20.1. Scalar fields in 3D are 
typically rendered using these basic techniques on 2D slice planes of the body (more gen- 
erally, these methods can be used on any 2D surface — for example, a color density plot 
could be shown on the surface of a machine part) 




0.5 1 1.5 2 2.5 3 



0.5 1 1.5 2 2.5 3 



Figure 20.1. Three types of visualization for scalar fields, (a) contour plot, (b) elevation plot, and (c) 
Color density plot [ranges through red-yellow-green-cyan-blue-magenta-red as the elevation ranges 
from minimum to maximum! . 



Now suppose you are given a vector field in 2D. The 
standard approach is to plot the vectors as a family of 
arrows in 2D space, as shown in the inset. ' You can 
alternatively generate streamlines that "flow" with the 
vector field. In three dimensions, you can generate vec- 
tor plots across any 2D surface, as was suggested in the 
case of a scalar field. However, in 3D, the vectors will 
not necessarily lie in the plot plane — they might have 
components pointing out of the plane. Consequently, if 
these sorts of plots are generated on, say, the surface of a 



\ \ \ WWW \\ \ \ 

\ \ \ www w \ \ 

\ \ \ www \\ \ \ 

\ \ x x www \ \ t, 
^ \ \ \\\\\\\v\ * 

^ ^ ^ -^ -^ -^ --k. -^ -^ -** ^ V ^ 



if// ////// / / t 

t / / //////// f t 

t / / //////// f f 

t / / /////// / / / 



* Incidentally, these three plots can be generated by the following mathematica commands: Con- 

tourPlot, Density Plot, and Plot3D. 
t This plot was generated using the mathematica command, <<Graphics "Plot- 

FieloV; Plot VectorField[ { Sin [x] , Cos [y] } , {x, 0, Pi} , {y, 0, Pi} ] 
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machine part, they can have the appearance of a hedgehog (in fact many people call these 
plots by that name.). If desired, the arrows can be colored in proportion to the magnitude 
of the vector. Another, less frequently seen, method for visualizing vectors is to assign the 
colors Red, Green, and Blue to vary in proportion to the three components of the vector 
Vj , v 2 , and v 3 . Then an ordinary scalar density plot could be generated using the mixture 
of colors. Then blue regions would indicate regions where v 3 is large in comparison to the 
other components. Yellow (which is a mixture of equal parts of red and green) would indi- 
cate regions where v l = v 2 and v 3 = 0). 

Clearly, visualizing vector fields is considerably more complicated than visualizing 
scalar fields. Vectors only have three components. How in the world can we visualize ten- 
sors, which have NINE components?!? We will describe here two standard methods for 
visualizing tensors. 



Mohr's circle for 2D tensors 

GOAL: Describe how to generate Mohr's circle for a 2x2 matrix that is not necessarily 
symmetric. 

Consider a 2D second order tensor whose components are of the form, 



^11 ^12 

F 2l F 22 



. A tensor takes on meaning only when it acts on a vec- 
tor. For visualizing a tensor, the most crucial question is 
how that tensor transforms a unit vector n . In the inset, 
we show a unit vector n and its transformation F • n . 
We define a to be the normal component of the trans- 
formed vector and x to be the shear component (with a 
sign given by the left-hand-rule, meaning that it is posi- 
tive if the transformed vector tends to shear the plane in 
a clockwise direction). 

To construct Mohr's circle, first define two points, 
an "H-point" and a "V-point" by 

H: (^11,-^21) 

V: (F 22 , F n ) 



(20.2) 




(20.3) 



(20.4) 

Note that these two points are the (a, t) pairs associated with n = E x and n = E 2 , 
respectively. In general, differently oriented normals will have different values of the 
(a, t) pairs. As the plane's orientation angle 9 varies, then so will a and t . Specifically, 
an arbitrary normal may be expressed in the form 



{n} 



cosG 
sin 9 



(20.5) 
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and the transformed vector therefore has components 



{F*n} = [F]{n} 



(20.6) 



F n cos9 + F 12 sin9 
F 21 cos9 + F 22 sin9 

from which it follows that 

Need to finish this section 

x = (20.7) 

and 

a = (20.8) 

A phase space curve of x vs. a can be constructed by plotting (a, x) pairs for various 
orientation angles. This plot is called a Mohr diagram. Naturally, because 9 is cyclic, the 
curve would have to be some sort of a closed loop. It turns out that this closed curve is in 
fact a circle and that planes separated by a distance A 9 in physical space will be separated 
by an angle 2A9 in the Mohr diagram. Recalling that the H and V points correspond to 
normals that differ by 90° , this means that on the Mohr plane, the H and V points will be 
separated from each other by 180° . In other words, the H and V points will lie on diamet- 
rically opposite locations of the Mohr's circle. Consequently, the center of Mohr's circle 
must be exactly between the H and V points. This is enough information to draw the 
Mohr's circle. 

Moving an angular distance a , measured from the H-point, corresponds to a and x 
values on Mohr's circle which are the normal and shear components of the transformed 
vector F • n for which n is at an angle a/2 measured from the horizontal. This halving 
or doubling angles when moving back and forth between the Mohr diagram and the phys- 
ical plane can be confusing, and there is a really kool way to get around this problem by 
introducing a third point — called the pole point — on the Mohr diagram. This point is 
found by passing a horizontal line through the H point and a vertical line through the V 
point. These lines will intersect at the pole point P. You can measure angles in the Mohr 
plane from the pole point, and those angles will precisely equal the angle in the physical 
plane. 
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"You shouldn't put down a loser, Cindy., 
you might be one yourself some day" 
— Carol Brady, The Brady Bunch 

21. Vector/tensor differential calculus 



Stilted definitions of grad, div, and curl 

Up to now, this book has focused on vector and tensor algebra, not calculus. A stan- 
dard rigorous (and therefore stilted) development of tensor calculus, as found in any good 
tensor analysis textbook, often begins by defining 

grade)) = lim - { n§dS (21.1) 

da 

gradw = lim — [ nudS (21.2) 

8Q. 

diva = lim - [ n • udS (21 .3) 

8Q. 

curia = lim - f n x udS (21 .4) 

8Q. 

Here, V is the volume of an arbitrary region Q, in space, and dQ. is its boundary with an 
outward unit normal n . Furthermore, dS is the area element, so the above integrals are 
really double integrals. Other ways to define these derivative operations (discussed later) 
do not require calling upon geometrical concepts such as volume or area. When these 
alternative definitions are adopted, the above equations come out as results. Alternative 
definitions of differentiation (discussed later) are superior if you are interested in evaluat- 
ing variations with respect to something other than the spatial location x . 

In terms of rectangular Cartesian coordinate systems (RCS), these derivative opera- 
tions can be computed by 



grad<|> = e k -^- (21.5) 

ax k 



du: 
grada = eg.-r 2 (21.6) 



~Jdx ( 
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diva = — - (21.7) 

dx k 

du k 
curia = €;s p — (21.8) 

Most modern books go on to acknowledge the following common alternative nota- 
tions (structures): 

V(j) means the same thing as grade)) (21 .9) 

Va means the same thing as grada (21 .1 0) 

V • u means the same thing as diva (21 .11 ) 

V x a means the same thing as curia (21 .12) 

Note that Va is a second-order tensor (class F 2 ) whose ij component is given by 
du-/dx r Later on, we will discuss an alternative definition of the gradient for which the 
ij component is du/dx- , the only difference being the ordering of the indices. 

Also note that 

V«a = tr(Va) (21.13) 

Vxh = s:(Va) (21.14) 

Consequently, if the tensor Va is available, then the divergence and curl can be readily 
computed without having to compute any spatial derivatives again (an efficiency advan- 
tage for computational analysis). 

Another common operation seen frequently in tensor calculus is the Laplacian, which 
is simply the divergence of the gradient and is commonly denoted by the operator V 2 : 

V 2 (|) = div(grad(()) (21.15) 

For rectangular Cartesian systems (RCS), this can be computed by 

V 2 4) = -^J- (21.16) 

ox k dx k 

Gradients in curvilinear coordinates. The component formulas for computing gradi- 
ents (or divergences, or Laplacians, or any other operation that involves differentiating 
with respect to the position vector) become more complicated in curvilinear (non-RCS) 
systems such as cylindrical or spherical coordinates. That's because the base vectors in 
curvilinear systems are themselves functions of position and, consequently, changing the 
position vector will change both the position vector's components and its basis. Compo- 
nent formulas for the gradient operations in other coordinate systems can be found in vir- 
tually any mechanics textbook (the tables in Ref [4] are particularly well done). 
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Before pulling a formula from a table, however, you should look at the table's entries 
for RCS to ensure that the authors have defined the gradient in the same way that we have. 
If not, you'll have to do a quick translation. Many authors, for example, define Vh to 
have ij components given by du/dx- , which is the transpose of how we have defined the 
gradient in this section. If you have a table that uses this index ordering, all you have to do 
is swap around the indices in the table accordingly. For self-consistency of our tensor 
structures (i.e., our notation), we will always define the indicial forms in a manner analo- 
gous to similar looking vector operations. For example, if V were a vector (it's not), then 
Vu would be a dyad with components V ; w . The V is not a vector — it's an operator. 
Nonetheless, the arrangement of indices in any expression involving V will be the same 
as an expression of the same form with V the operator replaced by V the vector. In indi- 
cial expressions, every place that the vector version has V ; , the gradient operation will 
have — , which acts on operands to its right. Again, keep in mind that these statements 
hold only for RCS coordinates, and must be generalized if curvilinear coordinates are 
used. Later on, we will discuss a left operating gradient as well. 

The general theory of curvilinear coordinates is covered in Ref [6] (or in numerous 
other standard textbooks on tensor analysis), where it is shown that gradient operations 
will always involve extra terms resulting from spatial variation of the base vectors. In gen- 
eral curvilinear theory, this effect is accounted for through the appearance of Christoffel 
symbols. There are two kinds of Christoffel symbols, the first represents the change in the 
base vectors with respect to changes in position coordinates and the other represents the 
gradient of the position coordinates themselves. Thankfully, the necessary mathematics 
for computing gradients in the most common curvilinear systems (e.g, cylindrical, spheri- 
cal, elliptic, parabolic, etc.) have been worked out long ago, and practicing engineers only 
need to look up the appropriate formulas in tables. The modern approach is to work out 
general physical theories using RCS coordinates, making certain that every step in any 
derivation is using only proper tensor operations (addition, scalar multiplication, contrac- 
tions, swaps, gradients, etc.). Once a final result is obtained, it should be cast in symbolic 
(structured) form so that, if desired, the formula for that same operation in a non-RCS sys- 
tem can be simply looked up in a table. If, for example, your RCS analysis resulted in the 
equation 

p + pj^ = (21.17) 

then you should not stop there! Your final result should be cast in structured form as 

p + p(V« v) = (21.18) 

With this result, you can go to a table for the divergence in, say, cylindrical coordinates 
and immediately write down the version of the result that applies for that curvilinear sys- 
tem: 
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(21.19) 



This formula is not too vastly different from the RCS formula, but you will find that dif- 
ferences become increasingly pronounced for multiple gradient operations or for gradients 
of higher order tensors. Incidentally, note that the above formula has the divisor of "r" in 
the middle term — without it, the equation would not be dimensionally correct. 

This "look it up in a table" mentality should not be treated as a licence to be sloppy, 
nor should it be paralyzing if you don't happen to have a table with you at the time you 
need a curvilinear formula. You can always go back to basics. Suppose, for example, that 
you need the formula cited in Eq. (21.19), but you don't have a gradient look-up table 
handy to find out how to express V • v in cylindrical coordinates. To figure it out on your 
own, first write the vector v in terms of cylindrical coordinates: 

v = \e r + v Q e Q + v z e z (21.20) 

From here, you can use linearity of the divergence operation in combination with formulas 
for the divergence of a scalar (in this case each coefficient) times a vector (in this case, the 
spatially-varying base vectors). This process will be described soon. The point here is that 
you don't have to just give up when you don't have a gradient table, nor do you need to 
invest time in learning general curvilinear theory unless you are routinely needing numer- 
ous curvilinear gradient formulas for obscure curvilinear systems. 

When do you NOT have to worry about curvilinear formulas? So far, we have 
defined the meanings of various gradient operations, all of which involved derivatives 
with respect to the position vector. We have explained that you need to look up special for- 
mulas for gradient operations when you use a curvilinear coordinate system. These special 
formulas reflect that the curvilinear basis itself changes when you change the position vec- 
tor. 

Many physical operations involve derivatives with respect to the position vector, but 
equally many involve derivatives with respect to other vectors as well. For example, the 
kinetic energy per unit mass of a material is given by 

K = -v • v (21.21) 

You can compute the derivative of k with respect to the velocity in much the same way as 
you would compute the spatial gradient. To indicate that the derivative is with respect to 
velocity v , many people put a subscript "v " on their nab la so that 



<3v- 



\W 



2^ 5 ik v k + v k 5 it> 



e f = v i e i = v (21.22) 

We can derive this in a more explicit manner by writing Eq. (21.21) as 



K = |(W + vf + vf) (21.23) 



254 

Copyright is reserved. Individual copies may be made for personal use. No part of this document may be reproduced for profit. 



September 4, 2003 5:24 pm 
Vector/tensor differential calculus 



The gradient with respect to v is given by 



V v k = — e x + —e 2 + —e 3 21 .24 



or 



V v k = v l e l +v 2 e 2 + v 3 e 3 (21.25) 

Now suppose that a curvilinear basis is used. Do we need to revise this formula? No! Here 
we are differentiating with respect to velocity, not the position vector. The basis changes 
when the position vector changes, but the basis is not a function of the velocity vector. In 
terms of a cylindrical coordinate system, the velocity vector is 

v = v r <? r + v e€e + v z€z (21.26) 

and therefore 

K = |(v r 2 + v2 + v z 2 ) (21.27) 

The derivative of k with respect to v is given by 

rj\C {J\C f/K" 

V = S7 r ~'" + 0V' + 3v^ = V r e ~r + v e€e + v z€z (21 .28) 

Contrast this with the spatial gradient of k , which is given by 

„ 3k , 13k , 3k 

Vk = —e + -—e + —e^ (21.29 

dr~ r rdQ~ r 8z~ z v ' 

The spatial gradient has the divisor \/r in the middle term, but the gradient with respect 
to velocity doesn't (note that putting it there would foul up the physical dimensions of that 
term). The derivative of k with respect to v looks essentially the same as the Cartesian 
formula except that the indices 1,2, and 3 are replaced by r , 9 , and z . 

In most engineering problems, a curvilinear basis is used only for the position vector. 
Hence, only formulas involving spatial derivatives will need special forms. As another 
example, consider the fourth-order elastic stiffness tensor from elasticity: 

os kl 

This tensor does not involve any spatial derivatives. Consequently, it takes an identical 
form in a curvilinear system. For example, 

E rm = ^f (21-3D 

0S rQ 

Keep in mind that an unadorned V is reserved for spatial gradients. In other words, V 
means the same thing as V . 



255 

Copyright is reserved. Individual copies may be made for personal use. No part of this document may be reproduced for profit. 



September 4, 2003 5:24 pm 
Vector/tensor differential calculus 



Spatial gradients of higher-order tensors. Let J be a spatially varying second-order 
tensor. Its gradient is a third-order tensor defined 

gradT= lim - [ nTdS, (21.32) 



en 

which is also denoted V J. 

In terms of a Rectangular Cartesian System (RCS), the indicial formula for the tensor 
gradient is 

(VJ) = — sd (21.33) 

* PQ r dx 

In RCS basis notation, 

V ^= -a^-s»s^ (21 - 34) 

The ordering of the indices is important. For example, 

(VJ) * (VJ) (21.35) 

For non-RCS systems, the component formulas become far more complicated and will 
involve Christoffel symbols (bleach!). Whenever possible, just go look up the result in a 
table for your system of interest. Yes, you should be capable of deriving it on your own, 
but the analysis is so complicated that the probability of a mistake far outweighs the likeli- 
hood you will happen to pick a reference book that has the formula wrong. It is a simple 
matter of risk-management. 

The divergence of a second-order tensor (which plays a pivotal role in the continuum 
equations of motion) is a first-order tensor (i.e., a vector), defined 

divJ= lim - f n • TdS , (21.36) 

Also denoted by V • J, this divergence operation is given in RCS component and basis 
notation as 

(V.J) = — ±i (21.37) 

dx k 

V. J = -r-^Sj ( 21 - 38 ) 

ax k 

Cylindrical and spherical coordinate formulas for this operation can be found in virtually 
any book on continuum mechanics. 

Note that 

V • J = Cj[VT] = I:[VT] , (21 .39) 

where C\ denotes contraction of the first two base vectors [See page 241]. 
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The curl of a second-order tensor (which plays a role in non-local and polar theories of 
material modeling) is a second-order tensor, defined 

curlJ= lim \ r [ n x TdS , (21 .40) 

Also denoted by V x T, this operation is given in RCS indicial and basis notation as 

Vx r= limn-a^-Wi (21-42) 

Note that 

Vx T = s:[VJ], (21.43) 

Note that both the divergence and the curl can be obtained from the gradient V J by 
applying a second-order inner product (i.e., a double dot, or double contraction) between a 
constant isotropic tensor (either the identity or the permutation tensor) and V7\ This 
observation can prove useful when (later) evaluating integrals; specifically, both the con- 
stant isotropic tensor and the contraction operation (which is a linear operation) can be 
pulled "outside" the integral in many instances. 

Spatial gradient operations for higher order tensors are defined similarly (consistent 
structure). 

Product rule for gradient operations. For scalars, the product rule of differentiation 
says 

d(f(x)g(x)) = f(x)g , (x) + g(x)f(x) > (21 44) 

dx 

where the prime denotes differentiation. Similar rules exist for gradients (or divergences 
or curls) of products of higher-order tensors, but the issue of basis ordering becomes para- 
mount. When seeking to derive such a formula, your best strategy is to apply the product 
rule to the RCS components, and then reconstruct the direct notation (structured) formula 
once you're done. 
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The direct notation formulas for scalar and vector arguments are straightforward and 
relatively intuitive. However, gradient formulas for second and higher-order tensors must 
frequently use of the exchange (swap) operator X\ discussed on page 242 if they are to be 
expressed in direct (structured) notation. The key concept is 



Dyadic ordering must be preserved in gradient operations 

(21.45) 

For example, V(av) is a special case of the gradient of a second-order tensor (because 
a dyad is a tensor). The result must be a third order tensor, expressed in RCS basis notation 

as 

3(«,v) 
V(«v) = -Q^-e^ej (21.46) 

Imagine for a moment that the V is a vector. Then self-consistency of this book's tensor 
structures says that it must be multiplied dyadically with hv . The del V comes first, then 
u, then v. Expanding V(av) with a product rule must result in an expression that pre- 
serves this exact same ordering. The base vector that goes along with V has to come first. 
The base vector that goes with u comes second and the one with v comes last. Using the 
product rule, the derivative may be written in RCS basis notation as 

V( - } = {^ V ) e ~n e ~i e ~J + { U i^) e ~n e ~i e ~J (2147) 



n n 



Consider the first term on the right-hand side of this equation. Equation (7.60) permits us 

to move over the v, factor so that it is adjacent to the e base vector. Doing this allows us 

j J ~j ° 

to write that first term in direct (structured) notation: 



dUj 

— v- \e e e 

dx n j)~"~'~j 






{■Vfij} = [V«]V, (21.48) 



The last term right-hand side of Eq. (21.47) is not so easy. Equation (7.60) tells us that sca- 
lar multiplication of dyads is a commutative operation — the scalar may "move around" 
freely, attaching itself to any of the vectors that form the dyad or triad. Unfortunately, 
however, dyadic multiplication itself is not commutative (it's order dependent). While it is 
permissible to move the u i over to be adjacent to e- , it is not permissible to move the e- 
over to become adjacent to u r Doing that would change the basis triad ordering from 
e n e i e i to e-e„e- , which is not the same triad, so the move is not permissible. There is no 
way to express the last term right-hand side of Eq. (21.47) in structured notation without 
using a swap operation. Intuitively, you might anticipate the second term to come out to 
be w(Vy), however this is wrong — we've shown that this result would entail invalid 
rearrangement of the basis triad. Stated differently, it fails to preserve the required "V- 
then-a -then-v" ordering. However, you can apply a swap operation, X\ to the expression 
u{ Vv) to put the basis ordering back to what it's supposed to be. Therefore, 

U i-fa) e ~n e ~, e ~j = X H»(VY)], (21-49) 
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and we have our product rule identity in structured notation: 

V (#Y) = ( v #)y + ^[«(Vv)] (21.50) 

The rule about preserving dyadic ordering applies only to the dyadically multiplied vec- 
tors (or vector-like quantities such as the "nabla" or "del" V ) — not to the ones that are 
"annihilated" by a dot product or other contraction (but you do need to make sure that the 
same vectors (or vector-like quantities) are annihilating each other in each term. For 
example, in our identity list below, we cite the formula 

v# (<l>v) = v • (V<|>) + <|>(V • v) (21.51) 

At first glance, the operand ordering might appear to be " V -then-(() -then-v ". However, § 
is a scalar, so it is not required to be part of this ordering. Furthermore, even though the 
dyadic product of two vectors is order dependent (qb ^ bq), the dot product is not order 
dependent q • b = b • q . Are the same "vectors" annihilating each other in every term? 
Yes. On the left hand side, the nabla V "annihilates" the vector v (so their ordering 
doesn't matter, but they must still annihilate each other in each term of the identity). On 
the first term of the right hand side, the vector v is still annihilating the nabla, and it is 
doing the same on the last term. Order dependence is not required on the del or the v in 
Eq. (21.51) because, after the dot product, there exist no base vectors to keep ordered — 
the result is a scalar. Only dyadically multiplied vectors (or vector-like quantities) must 
preserve order. After a while, these subtleties will become second nature to you. Until 
then, your best bet is to work out identities like this using RCS indicial notation, and then 
cast the final result back to symbolic structured notation (you need to cast back to struc- 
tured notation if you wish to apply the identity in curvilinear coordinates, where the RCS 
formulas don't apply; the fact that you temporarily used RCS in your derivations is incon- 
sequential — once you have the structured formula, you can write it down in any system 
you prefer by using appropriate tabulated formulas for each operation). 

Identities involving the "nabla". 

Identities that involve the "nabla" V gradient operator are listed below. For clarity, the 
equivalent identity is also expressed indicially for a rectangular Cartesian system (RCS). 
Though easier to interpret, the indicial expressions are valid only for RCS. Different for- 
mulas must be used for curvilinear systems [see page 252]. We highly recommend that 
you do not try to memorize this list or carry it around with you. Chances are that whatever 
identity you need for a particular application won't be listed here. Instead, you should use 
this list as a "practice-ground" for you to learn how to prove the formulas yourself. 

(21.52) 



v(<h/) = (KVi|/) + i|/(V(|)) 


d(<|>\|/) _ 
dx n 


*(tym 


v (^*v) = (V«) • v + (Vv) • « 

also see Eq. (21.70) 


d ( u k v k) 

dx i 


\dx/ k \dxJ k 



(21.53) 
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V(4> + V ) = Vc() + Vvk M±V) = d±+dy 

dx„ dx„ dx„ 



(21 .54) 



8(u r + v ; ) du: dv- 

V(u + v) = Vu + Vv — -i - = -^ + ^- L (21.55) 

3x„ ox„ ox„ 



V(§u) = (V(|))« + 4>(Vw) 
v Ov) = (Vm)v + Z2[«(Vv)] 

V • (V X v) = (see below) 

V x (V())) = (see below) 

v»(<|>v) = v • v<|> + (j)V • v 

Vx((|)v) = <|)V x v + (V(|>) x v 

^ • (^ x y) = H * (^ x *{) ~ r i * C? x 1?) 

Vx (^xv) = k(V«v)-h»(Vv) + v»(V«)-v(V»h) 

V • (V(|> x V\|/) = (see below) 
Vx(Vxv) = V(V • v) - V 2 v 
vx(Vxh) = 2[skw(Va)] • v 
The identity (21.58) follows from noting that, for any sufficiently smooth function fix, y) , 

JJ- = JL (21.67) 

dxdy dydx 

When applied to a double gradient, this calculus identity may be written 

?LA = ^LA (21 . 68) 

dx-dXf dx:dx- 

In other words, there is symmetry with respect to the indices i and / . Consequently, the 
second partial derivative in Eq. (21.58) is symmetric with respect to the i and / indices. 
When contracted with z t - k , which is skew-symmetric in its i and / indices, the result must 
be zero. Equations (21.59) and (21.64) are zero for similar reasons. 



8x n \8xJ ' ^dxj 


(21.56) 


d(u t v) du t dvj 
8x n dx n J l dx n 


(21.57) 


d du k __ ... d2u k ^ 
dx ; ijk dx; ijk dx i dx i 

1 J l J 


(21.58) 


d(d<\>/dx k ) __ d 2^ _ 
ijk dxj " iJk dxjdx k 


(21.59) 




(21.60) 




(21.61) 




(21.62) 


u)- v(V • u) 


(21.63) 




(21.64) 




(21.65) 




(21.66) 
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Compound differential operator notation (and unfortunate pampering). You will 
frequently see authors use a compound gradient operator such as "(« • V) ", the meaning 
of which depends on the operand. For example, the notation (u • V)(|) means the same 
thing as u • (V(|)) and the notation (u • V)v means the same thing as u • (Vv) . Note that 
this equivalence is similar to saying that (a • b)c means the same thing as a • (be) . 

As a general rule, if you are ever faced with "deciphering" a compound gradient oper- 
ator (i.e., one that involves a gradient and other things), then the indicial form for the oper- 
ation should be similar to the indicial forms of algebraic equations where the nabla/del is 
replaced with an ordinary vector. Just keep in mind that the nabla will be operating on 
everything to its right in a given term (or up through a closed parenthesis if the operator is 
intended to act on multiple terms). 

Upon occasion, you will need to work with another person who doesn't have a back- 
ground in tensor analysis. Such a person will not be able to decipher an expression like 
(V«) • v because this expression involves a tensor V« which is foreign to them. To help 
these people out, you can replace (Vw) • v by something more familiar to non-tensor- 
savvy researchers through the use of the following identity: 

( V #) * Y = (Y * V )# + Y x ( V x U) (proof below) (21 .69) 

Using this identity, for example, you can write the identity of Eq. (21.53) as 

v O • Y) ~ (Y • v )# + (# • v )f + v x (V x a) + a x (V x v) (21 .70) 

which is what you would typically find in a standard handbook such as the CRC [3]. There 
is absolutely no reason to use this horrendous identity unless you are dealing with a "ten- 
sor-challenged" audience. The identity of Eq. (21.53) is far more elegant and less prone to 
computational error. 

Recall that the compound operator (v • V) in an expression of the form (v • V)« is 
merely an alternative notation for v»(V«). The compound operator is introduced to 
make the presence of a tensor transparent to people who aren't familiar with them. Note 
that v • (V«) & (Vh) • v . Instead, v • (V«) = (V«) r • v . A simple — but of course cru- 
cial — difference of arrangement of indices that distinguishes these expressions. 

To prove Eq. (21.69), consider the expression vx(Vx«),In indicial form, this is 

fvx(Vx«)}.= 8. v Is —u) (21.71) 

11 V" ~ ) I i imn m\ npq p, x qj v*-'-' '/ 

This expression has two permutation symbols, and the index "«" appears on both of them, 
so you can use the e-delta identity to write 

(21.72) 



{v x 


(Vx«)}. = 


^ip^mq 


~ 5iq d mp) V , 


dU q 

n 8x p 


Multiplying 


this out gives 








{v x 


(Vx«)}. = 


d _Uq 

v — 2 — 

qdx i 


du j 
V P~d7 p 





(21.73) 
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In structured notation, this result may be written 

vx(Vxh) = (V«) • v - v • (V«) (21 .74) 

Solving for (V«) • v gives the result of Eq. (21.69). This result, by the way, is also the 



proof of Eq. (21.66). 



Right and left gradient operations (we love them both!) 

You can define the gradient, divergence, and Laplacian formulas differently from the way 
they were defined in the previous section. Specifically, you can define 



GRAD<|>= lim - [ §ndS (21.75) 

8Q. 

GRADw = lim -. f undS (21.76) 

DIVw = lim - f a • ndS (21 .77) 

8C1 

CURLw = lim - f u x ndS (21 .78) 

~ v->oVi ~ ~ 
da 

Note that the only difference between these formulas and the ones in the previous section 
is the placement of the unit normal n . In terms of rectangular Cartesian coordinate sys- 
tems (RCS), these operations can be computed by 

pa 

(21.79) 

(21.80) 

(21.81) 

(21.82) 

Writing these operations using a "del" V operation requires the introduction of a new del 
symbol, V . This is a backward operating gradient defined such that 

(j)V means the same thing as GRADcj) (21 .83) 

aV means the same thing as GRADw (21 .84) 

u • V means the same thing as DIVa (21 .85) 
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GRAD(^ 


= e ^L 

~ k dx k 


GRADw 


= — e e 

dxj~ l ~J 


DIV« = 


dx k 


CURL*/ 


Bit, 
v k dx k ~'' 



(21.87) 


(21.88) 


(21.89) 


(21.90) 


vx«. Note that Va 


(21.91) 


(21.92) 
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kxV means the same thing as CURLa (21 .86) 

To avoid any confusion when working with both types of gradient operators, the "del" 
symbol used in the previous section can be alternatively written as a forward operating del 
as V. 

Note that 
<|>V = V<|> 
wV = (Vuf 
u» V = V«« 

«xV= -(V x u) 

The last formula is similar to the ordinary vector identity, u x v = 
is a second-order tensor (of class Vj). Consequently, 

«• V =tr(«V) 

«xV = e:(«V) 

The Laplacian, which is simply the Divergence of the GRADient and is commonly 
denoted by the operator V 2 : 

(j)V 2 = DIV(GRAD^) = V 2 (() (21.93) 

Sadly, the backward operating gradient is rarely seen in publications. We won't deny that 
it is certainly difficult to typeset. Nonetheless, it is very useful to recognize that these 
alternative definitions of differentiation exist. For both the forward and backward operat- 
ing dels, note that the index on the 8( )/dx k is the same as the index that would be used 
if the del were just a vector. For example, if d is a vector, then dyad du would expand as 
djiije-e, , which is similar in structure to 

Vw = ^-u.e.e. (21.94) 

ox i J ' J 

Conversely, the dyad ud would expand as u^-e^. , which is similar in structure to 

«V = (du/dx i )e i e. (21.95) 

Despite this heuristic notation, keep in mind that the del is not a vector. The issue of right 
and left operating dels comes up implicitly in the mechanics literature, where it is not 
uncommon to see authors (e.g., Ref. [18]) to define Va to mean T- L e i e j in their nomencla- 
ture section, but later state that the velocity gradient tensor is Vv = j-'g ; -g,- , which is actually 
a backward gradient. This is an infuriatingly sloppy structure consistency violation. It 
undermines the goal of having heuristically self-explanatory notation. 
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Other authors [e.g. 24] define the gradient GRADa with respect to x by being more 
explicit in the presumption that u is expressible as a function of x so that there is a func- 
tion g such that u = g(x) . Then GRADa is defined to be the linear transformation (if it 
exists) for which 

g(x + s) = g(x) + (GRADa) • s + o(s 2 ) (21 .96) 

Here, the symbol "o" represents "order" and o(s 2 ) represents a function f(s) for which 

limMM = (21.97) 

*->9 ||s|| 

Note that Eq. (21.96) looks a lot like a first-order Taylor series expansion. When this 
approach is used to define the gradient, then Eq. (21.2) comes out as a result. If you think 
about it, this definition is pretty close to the definition of ordinary differentiation that you 
might see in an undergraduate calculus book. If you think of s as being an infinitesimal 
increment dx , then g(x + s) - g(x) can be regarded as an increment du and therefore 
Eq. (21.96) can be written somewhat less cryptically as 

du = (GRADa) • dx (21.98) 

Using our nabla notation, this would be written 

du = aV • dx (21.99) 

The other derivative operations can be defined similarly using this approach. 

Unfortunately, many authors [e.g., 24] define the gradient as shown in Eq. (21.98) — 
which is a backward or "right" gradient — but they still use a nabla on the left so that they 
write Eq. (21.99) as du = (Va) • dx . We find this horribly confusing. With our distinc- 
tion between left and right gradients, the forward (left) gradient would be defined in ana- 
log to Eq. (21.98) as 

du = dx»(gradu) (21.100) 

which would be written using the nabla as 

du = dx* Va (21.101) 

Note that, regardless of whether a forward or backward nabla is used, the spatial incre- 
ment dx is always positioned so that it dots directly into the nabla. Again, we contend that 
both backward and forward gradients are useful, but we feel adamant that the notation 
should carefully distinguish between them. Incidentally, as you move along to gradients of 
higher-order tensors, even more types of gradients can be defined according to the index 
placements. For example, here are three possible definitions of the gradient of a second- 
order tensor: 

(forward_grad £/).., = — J - (21.102) 

* y* dx t 

8U-, 
(middlejgradj7) i/jt = -^ (21.103) 
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dU u 
(backward_grad £/).., = — - (21.104) 

* y* dx k 

We would be hard-pressed to come up with a simple direct notation for the middle gradi- 
ent, and the situation would only get worse for higher-order tensors. Note, however, that 
the only distinction between these definitions is the index ordering. We have defined the 
exchange operator as a mechanism for re-ordering indices. Hence, you can always com- 
pute a gradient using any index placement you prefer, and then easily obtain the other gra- 
dients by exchange operations. Specifically, 

du u 

f/V = backward grad[/ = -^e-e-e, (21.105) 

* - ~ dx k ~'~ J ~ K 

(middle_gradf7).., = Xl(uV) (21.106) 

s IJK a 

(forward_grad0.. t = X$X$(UV) (21.107) 

What a mess! Our point here is that you can get to any other gradient definition if you 
have computed it using another definition — all that's needed is exchange operations. This 
fact can be very convenient in product rule situations. 



Casual (non-rigorous) tensor calculus 

The gradient operations that we have defined so far don't appeal to the intuition of 
people who are new to this subject. Furthermore, definitions like these immediately trap a 
person into a mindset that tensor calculus always has something to do with how fields 
(scalar, vector, or tensor) vary in space where the independent variable is the position vec- 
tor x. However, whenever you have a quantity (tensor or scalar) whose value can be 
expressed as a function of some other quantity (tensor or scalar), then straightforward 
extensions of scalar calculus exist to permit you to quantify how the first quantity changes 
in response to a change in the second quantity. For example, in elastic materials modeling, 
the stress tensor often depends in some measurable way on the strain tensor, and the deriv- 
ative of the stress tensor with respect to the strain tensor turns out to be a fourth-order ten- 
sor — called the elastic tangent stiffness — that is completely analogous to Young's 
modulus E in the uniaxial stress equation a = Es . 

To approach tensor calculus in a more casual way, we will define our calculus notation 
through a series of examples with the understanding that you should force yourself to plod 
through more the formal expositions on this subject available in any good tensor analysis 
textbook. 

Whenever we write 

dy 

-r, (21.108) 

ax 
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we are implicitly telling you that the vector y can be expressed as a function of a single 
vector x . Consequently each y i component must be a function of the three {x v x 2 , x 3 } 
components. By the chain rule,* 

dy t 
dy = dy f e. = —dx t e. (21.109) 

1 ox- J ~ l 

Noting that dx ■ = dx • e. , this may be written 

dy = —(dx • ej)e t = [— e^) • dx (21.110) 

Even if y is a nonlinear function of x , note that the infinitesimal increment dy is linear 
with respect to dx . Thus, recalling Eq. (9.7), we have now demonstrated that there exists a 
second-order tensor, which we will denote dy/ dx , such that 

dy = (-A »dx (21.111) 

Comparing with Eq. (21.110) shows that 

dy dy; 

If x is the position vector, note that dy/dx is actually a backward-operating gradient. 

SIDEBAR: "total" and "partial" derivative notation. Note that we have quietly 
introduced our notational preference to use a "d" when writing dy/dx even though we 
must, by necessity, use a "3" in the partial derivative on the right-hand-side indicial 
expansion. This choice has been made quite deliberately in order to maximize the analo- 
gies that tensor calculus has with ordinary scalar calculus. To get a better appreciation of 
why we have made this choice, consider the scalar calculus situation in which some vari- 
able y is expressible solely as a function of an independent variable x . Then, of course, 
you would naturally write dy/dx, not dy/dx . The very act of writing dy/dx tells you 
that y really can be written solely in terms of x . If it turns out that y can be alternatively 
written as a function of two other variables, u and v, then we could use the chain rule to 
write 



In Eq. (21.1 09) we have written dy/dx- on the reasonable assumption that you will understand this 
to mean the partial derivative with respect to x , holding all other components of x constant. 
Except in this very special case, we strongly recommend explicitly showing what variables are held 
constant in partial derivatives whenever there is even the slightest chance of misinterpretation or 
confusion by your readers. This issue pops up continually in thermodynamics. The partial deriva- 
tive of pressure P with respect to volume V takes on different values depending on the conditions 
at which the measurement is made. If, for example, the variation of pressure with volume is mea- 
sured at constant temperature T, then the derivative should be written (8P/8V) T . However, if the 
measurement is made under reversible insulated (no heat flow) conditions, then the derivative 
should be written (pP/dV) , where s is entropy. The two derivatives aren't equal! 
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%-(¥)t + (¥)t (21 - 113) 

dx \ou/ v dx VovJ u dx 

Note that we use "d" on the left-hand-side, and "3 ' on the right hand side where partial 
derivatives exist, and "d" again for the total derivatives of u and v. The situation with vec- 
tor derivatives is very similar. We have a vector y that can be computed if we know the 
single vector x . Just as an automobile is a single entity composed of hundreds of parts, we 
say x is a single vector because it really is a single entity even though it consists of multi- 
ple parts (components and base vectors). A velocity vector has three components, but you 
wouldn't say "the velocity ARE fast" any more than you would say "the automobile ARE 
fast. " A vector IS the sum (not "are the sum") of components times base vectors. A vector 
IS a single object. When y = f(x) , we can alternatively regard y to be a function of the 
three RCS components x x , x 2 , and x 3 . Then, in analog with Eq. (21.113) we would write 

dy dy dx, dy dx 7 dy dx-, 

_i = _sl — i + ^ — - + —<*■ — - (21.114) 

dx 0Xj dx dx 2 dx dx 3 dx 

Note the distinctions in the use of "d" and "3 " in this equation. It's not hard to show that, 
when the x are RCS components 

dx ; 

— ^ = e j (21.115) 

dx ~ J 

Likewise, since the base vectors themselves are fixed when using RCS coordinates, 

fy 3(y f g.) dy i 

dxj 8xj oxj 

Putting Eqs. (21.115) and (21.116) into (21.114), taking care to preserve the order of 
dyadic multiplication of the base vectors, gives us back our result of Eq. (21.112). 

There are other analogs with conventional scalar calculus that motivate our use of "J" 
on the left hand side of Eq. (21.112). In scalar calculus, everyone knows that 

dx 1 

— = — - — (21.117) 

dy dy/dx 

This identity holds if dy/dx ^ (otherwise, we would be dividing by zero). The analog 
for tensors is 

rdyi~ l 

(21.118) 



dx 

dy 



■dy- 
dx 



where the superscript "-1" is the tensor inverse. Of course, this property holds only if the 
inverse exists (i.e., only if det(dy/dx) * 0), just as Eq. (21.117) holds only if dy/dx ^ 0. 

Eq. (21.117) was applicable because y was expressible solely as a function of x. In 
general, 

dx 1 

dy dy/dx 
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Equality generally holds only if both partial derivatives hold the same variable constant in 
the derivative (in which case we are implicitly restricting our attention to a "world" in 
which that same variable is always constant; in such a world, y would be expressible solely 
as a function of x). To convince yourself that Eq. (21.119) is correct, consider polar coor- 
dinates in which x and y are expressible as functions of r and 9 . Namely 



x = rcosO 
from which it follows that 



and 



y 



rsinG 



(21.120) 



dx 

dr. 



dx 
8QJ,, 



dy\ fdy 



cos 9 -rsinG 
sin 9 rcosG 



(21.121) 



Equation (21 . 120) could, in principal, be inverted to obtain r and 9 in terms of x and y to 
permit directly computing (dr/dx) . However, to compute (dr/dx) , you can alterna- 
tively use implicit differentiation to obtain 



(21.122) 



\dxJ ,, \dyJ x 




(dx) (dx) 
\dr) e VdQJ r 


l 


cosG -rsin0 


-1 


cos 9 sinO 


ydxJy \dy) x 




( dJ ) i d A 




sin0 rcos9 




-sin 9 cos 6 
r r 



Note from Eq. (21.121) that 



— = cos9 



and Eq. (21.122) tells us that 



B y = cose 



Therefore, 



1 



dx) (3x/3r) e 



(21.123) 



(21.124) 



(21.125) 



If (for some strange reason) you wished to know the variation in r with respect to x hold- 
ing 9 constant, then you would be able to write 



dr 
dx 



1 



(21.126) 



{dx/dr) Q 

The only distinction between the above two equations is what variable is being held con- 
stant. In one case equality holds; in the other it doesn't — that's why it is so essential to 
explicitly show what's being held constant unless you are 100% sure there is no chance of 
confusion. Don't be so sure. In classic multivariable, scalar, calculus, the very act of writ- 
ing dy/dx tells your reader that y can not be written solely in terms of x — it must be 
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expressible in terms of x and whatever variable is being held constant in the partial deriv- 
ative. That's why we do not use "3 " when we write dy/dx . We want you to know implic- 
itly that y can be written purely as a function of x and nothing else. We would write 
dy/dx only when y depends additionally on other things, and we would be diligent to 
show what variable is held constant in the derivative if there is any chance for misinterpre- 
tation of what this second variable is. 

The "nabla" or "del" gradient operator. Researchers who use 3y-/3x-Jypically do so 
because this convention permits them to use the alternative notation Vy, where the 
"nabla" or "del" operator is heuristically defined such that 

V( ) = |^ €f , (21.127) 

With this "right-operating" del, the differentiation with respect to x acts on quantities to 
the right. Thus, the ij component of Vj has indices that are heuristically similar to the ij 
component of an ordinary dyad ay , namely a t y- . In other words, to ensure structural self- 
consistency, Vy would have to be defined such that 

dy = dx* (Vv) , which implies that (VvL = — '- (21 .128) 

~ J dx i 

To use a heuristic backward-operating "del" operator with our definition, we would 
have to define 

( )V = 8( ydxjBj, (21.129) 

which operates on arguments to its left. Then we could write 

dy/dx = yV (21.130) 

Then the ij component of yV would be heuristically similar to the ij components of yb . 
Thus, y V would be defined such that 

dy = (y V) • dx , which implies that (y V) . . = — (21.131) 

- - - v dXj 

Both the backward and forward operating del are used by Malvern and we also find 
that they useful, depending on the application at hand. For the applications in this book, a 
"del" operator is never needed. We will always use the "fraction-like" notation of 
Eq. (21.112), which is technically a backward-operating derivative. With the fraction-like 
notation, the indices are placed on the dependent variable y t and then on the independent 

variable x in the same order as the indices appear in the basis dyad e e . Because we will 

j ~i ~j 

always follow this convention, we may write dy/dx as 



* An example where there is no chance of confusion is in expressions such as d^/dx i . This partial 
derivative is with respect to x i holding the other x. constant. For example, dfy/dx 2 is understood to 
mean (dfy/dx 7 ) . Aside from this component-based exception, we recommend explicitly show- 
ing all other variables held constant. For example, (ds/dx 2 ) is understood to mean (ds/dx 2 ) 
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dy 

-T (21.132) 

ax 

without ambiguity. 

To ensure structural integrity, our convention of placing indices first on the dependent 
variable and then on the independent variable will extend to higher order derivatives as 
well. For example, the notation 

dU 

7t (21133) 

denotes a sixth-order tensor defined by 
dU, 



— - — eee,e,e e (21.134) 

UI klmn 

In contrast to Eq. (21.132), when we write a derivative with the "3" symbol instead of 
the "d" symbol, we are telling you that the dependent variable depends on more than one 
tensor or vector quantity. For example, by writing the notation 

tl (21135) 

we are implicitly telling you that y can be written as a proper function of x and z ■ The 
subscript also indicates that the vector z is being held constant in the derivative. Thus, the 
above derivative quantifies how the vector y would change if x were to be varied without 
changing z . For general variations in both independent variables, the total increment in y 
must include contributions from both dx and dz ■ Specifically, the above partial derivative 
must be defined such that 

^ = (|)/^ + (|)/^ (21 - 136) 

As before, if y is a function of x and z , then y i depends on the x- and z k components. 
Hence, 

d /X = dD ««• (21 ' 137) 



By the way, note that 



(21.138) 



dy 



d. 



This is true because the same quantity — namely, z — is being held constant on both 
sides of the equation. The property is not true if different things are held constant. Thus, 



dx 



dy< 



dx) w . 



l 



in general (21.139) 
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Okay, if the above relation does not hold, does anything LIKE IT hold? 

If you really wish to relate (dx/dy) to (dy/dx) , then you must be extra careful with 
your logic. The basic motivation for" seeking sucha relationship in the first place is that 
you must not have the actual function for x as a function of y and z available. Instead, 
you have y as a function of x and some other variable w . Recall that the very act of writ- 
ing (dx/dy) tells your reader that there does exist some function for x as a function of y 
and z even if you don't happen to have that function available at hand. Now, if x is a 
function of y and z , then it might be possible to solve this relationship to obtain y as a 
function of x and z- The very act of writing the expression (dy/dx) , implies that y 
must be expressible as a function of x and some other variable w . Thus" you have simul- 
taneous implied functions 

y = y(x,z) and j = y(x, w) (21.140) 

The only way these can both be true is if 

w = w(x,z) (21.141) 

Now you can apply the chain rule to write 

-dy\ fdy\ fQx\ . (d]T 



fdw\ 



dxJ z ^Sx^w ^dxJ z v3hv x ^-dxJ z 



(21.142) 



or, noting that (dx/dx) z is just the identity tensor, 

V3j(7 ? ^xxw- ^dwJ x ^dxJz 
Putting this into Eq. (21.138) gives 



(21.143) 






■^ + 



By 



dig 

d & z. 



-dwJ x 

Another set of commonly-used identities from single-variable scalar calculus is 

dw/dx 



dy 
dx 



dy/dw 
dx/ 'dw 



and 



The analogs in tensor analysis are 

dy 



dx 



dy rdx' 

— a. « — 2i 

dw dw 



and 



dy 

dx 



dy 
dx 



dw/ 'dy 



vdw 



dy. 



1 dw 

• — — 

dx 



(21.144) 



(21.145) 



(21.146) 



Note that the inverted tensor is on the right side of the dot product in one case but on the 
left in the other. The way to determine which one is correct is to start with the chain rule: 



dy 


dy dx 


2L. = 


— a. a — bl 


dw 


dx dw 



dw 


dw dy 




= — 2L # — a 


dx 


dy dx 



and 



Solving these expressions for dy/dx gives Eq. (21.145). 



(21.147) 
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For multi-variable scalar calculus, the identities equivalent to (21.145) are 

dJ] = (8y/8 W ) s ^ ^ = (dw/dx), (21148) 



^dxJ s (dx/dw) s ^dxJ s (dw/dy) s 

These identities are truly equivalent to (21.145) because the same variable, s, is being held 
constant in all of the partial derivatives. 

Another fundamentally different but similar identity states that 




(21.149) 

Note that this identity is completely different from the second one in Eq. (21.148) because 
of the variables held constant in the derivative. To derive this result, start with the basics. 
We are interested in converting a derivative for which s is an independent variable held 
constant into an expression where s is a dependent variable. The act of writing (dy/dx) s 
tells us that y = y(x, s) . In principle, we could solve this function for s = s(x,y) and it 
is this function that is being differentiated on the right-hand-side of Eq. (21.149). Writing 
out the chain rule for this function gives 

Ds Ds 
ds = —dx+—dy (21.150) 

ox Dy 

This expression holds for arbitrary variations of x and y . However, recalling that we are 
trying to obtain an expression for (8y/8x) s , what we really want to consider is variations 
of x and y that will involve no changes in s — in other words, we are restricting attention 
to motions for which ds = . Note that 

|f) = (21.151) 

regardless of what variable E, represents (other than s itself, of course). This equation is 
simply asserting that the variation of s holding s constant must be zero. We can therefore 
write the total increment chain rule of Eq. (21.150) in terms of partial derivatives holding 
s constant: 

dsrdA + d l fdy\ 

dx\dZj s dy\dtj s { ' 

Now let's make a choice for the variable h, . Taking £, to denote x , the above equation 
becomes 

= ^m + ^m (21.153) 

ox^ox/ s oyyoxy s 
or, since dx/dx = 1 no matter what is being held constant (except x itself of course) 

= 8 / + 8 /m (21.154) 

ox oyyoxy s 
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Solving for (8y/dx) s completes the proof of Eq. (21.149). 
For tensor calculus, the analog of Eq. (21.154) is 



or 



dx oy 


rdy\ 

KdxJs 


w. 


~ds~ 

dy_ 


-i ds 

• — a 

dx 



(21.155) 



(21.156) 

Note the rule of thumb: to derived tensor generalizations of familiar calculus derivative 
identities, you will always want to start with the chain rule. 



Directed derivative 

Consider a function / that depends only on x . The value of the function may be a sca- 
lar, vector, or tensor of any order. Recall that 

¥ = ¥ e ~i < 21 - 157 > 

dx dx t 

The gradient characterizes how the quantity f(x) changes in response to an incremental 
but otherwise arbitrary change in x . Let us now be more specific. Suppose that you are 
interested in simplifying the problem to a special case where x is known to change from 
some initial position x Q to a current position x such that it moves from the first to final 
point along a straight line segment. The vector connecting these two points can be defined 

S=X-* (21.158) 

The unit vector in the direction of the line segment s is defined simply 



s 



n = 



where s = Js» s (21.159) 



Js • s 
so that the position increment may be written 

s = sn (21.160) 

When restricting attention to situations where x moves only along the line segment s , 
then it makes sense to consider the scalar s to quantify the location. Using just s makes 
computations easier because it's always easier to work with scalars than with vectors. The 
directed derivative is the derivative of/ with respect to a change in distance s along 
the line segment in the direction of n . 

%=^-*n (21.161) 

ds ax ~ 
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EXAMPLE. 


Consider 






/=■* 


• • X 




Then 










df = 
dx 


dx- 


d{x^ k ) 

3X; 



Our use of partial derivatives on the left hand side is a break with traditional notation, but 
consistent with our self-imposed notation structure rules. We use partial derivatives here 
to emphasize that we are examining the change in f with respect to x , holding the allow- 
able direction of the change constant. 



(21.162) 



(8jH** + *Ai)Si = 2x. €/ = 2x (21.163) 

Suppose you wish to characterize how / changes when x moves in a direction that is par- 
allel to x itself. In this case, 

n = ~ (21.164) 

Jx»x 

and therefore the directed derivative is 

-/•» = (2x)*—±= = 2jx»x = 2\\x\\ (21.165) 

If you let r denote the magnitude of x , this means that 

& = 2r. (21.166) 

dr 

Given the way that the function is defined, you should have realized by now that a nat- 
ural choice for the basis is spherical { e r , e Q , e } . As a matter of fact, the function / in Eq. 
(21.162) can be alternatively written in terms of spherical coordinates as 

f = r 2 (21.167) 

making the result of Eq. (21.166) far less mysterious, and further indicating that the quan- 
tities held constant in the partial derivative are simply the other two spherical coordinates 
9 and \\f . We're talking about variations in/resulting from radial motion. Furthermore, in 
terms of spherical coordinates, Eq. (21.164) is simply 

4^ = 2re (21.168) 

dx 

Now suppose that you wish to consider how the function f changes in response to a 
change in x that is perpendicular to x . In Eq. (21.165) we showed that the unit vector in 
the direction of x happens to equal e r . Therefore, e Q is perpendicular to x , and it turns 
out that the directed derivative corresponding to changes in x that move in the direction of 
e Q are zero: 

I = f *? Q = (2re r ).e Q = 0, (21.169) 
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meaning that the value of f does not change when x moves in the direction of e Q , again 
not a surprising result in light of Eq. (21.167). 

To summarize, the directed derivative is best regarded as simply a way for you to 
explore in a step-by-step manner how a function changes in response to changes in x . All 
you have to do is simply consider different directions for x to move in order to gain 
insight into the field variability of f. Incidentally, note that df/dx i is itself a directed 
derivative, given by 

¥■ = j %e ~i ( 21 - 17 °) 

ox, ax ' 



Derivatives in reduced dimension spaces 

Suppose that you know that some scalar s can be expressed as a function of a vector 
x . Then, nominally, you may write ds/dx = (ds/dx i )e i . However, this is not really the 
correct result if the vector x is not allowed to take any possible variation. If, for example, 
the vector x is constrained such that it must always be a unit vector (i.e., if x must always 
point to a location on the unit sphere), then radial variations of the vector x are not per- 
missible. For situations like these, the definition of the derivative ds/dx must be rede- 
fined such that 

ds = f — J • dx for all permissible variations in x . (21.171) 

The way to compute this revised definition of the gradient is to first compute a nominal 
gradient on the assumption that even inadmissible variations in x are allowed. Then this 
nominal result must be modified to remove the inadmissibilities. Without this modifica- 
tion, the gradient will not be unique and could even lead to strange counterintuitive 
results! 

As an introduction to this important topic, consider a one-dimensional curve embed- 
ded in 3D space. Such a curve can be defined parametrically such that for each value of a 
scalar s there exists a unique point x on the curve. As a specific example, consider 

x = sE l + e s E 2 (21.172) 

The parameter s is here assumed to vary freely from -qo to oo . The non-parametric equa- 
tion for this space curve is simply x 2 = e X{ and x 3 = . 

The derivative of x with respect to s is 

=£ = E, +e s E ? (21.173) 

ds 

Not surprisingly, this result will always be tangent to the curve. 
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Because the curve is one-dimensional, we know that each position x corresponds to a 
unique value of the parameter s . Conversely, each value of s is associated with exactly 
one position vector x on the curve. Hence, s may be regarded as a proper function of x . 
However, what exactly is this function? Considering the coefficients of E { in 
Eq. (21.128), you can assert that 

s = x l (21.174) 

but you can alternatively consider the coefficients of E 2 to claim that 

s = lnx 2 (21.175) 

Both of these expressions will give the correct value for s as long as x lies on the space 
curve. However, directly differentiating these different expressions for s with respect to x 
gives different answers. We will call these derivatives the "nominal" derivatives, and we 
will denote them with a star: 

Eq. (21.174) gives [^) = E l (21.176) 

Eq. (21.175) gives (^) =— (21.177) 

These two expressions are perpendicular to each other, so they cannot possibly be equal. 
The discrepancy must be resolved by using a projection of the increment dx onto the 
space of allowable increments. From Eq. (21.172), note that 

dx = (E l + e s E 1 ) ds (21.178) 

Therefore, the increment in position must always be parallel to the vector 

b = E l +e s E 2 (21.179) 

You can define the projector onto this vector by using Eq. (10.14): 
b ® b E\E\ + eS ^2^\ + eS E l E 1 + e 2s E 2 E 2 



b • b 1 + e 2s 



(21.180) 
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Figure 21.1. Projecting an arbitrary position increment onto the space of 
allowable position increments. 



If dx is an arbitrary increment in x that may or may not lie on the space curve (see Fig. 
21.1), you can write the set of all allowable increments in the form 



(dxf 



P*dx 



(21.181) 



To make use of the definition of a gradient, the increment in s must be expressed in terms 
of truly arbitrary increments in x , not just constrained increments. This is done by replac- 
ing the constrained increment (dx)* by P • dx, which involves truly arbitrary incre- 
ments: 



ds = {f)'-^* = {fS- F .' dx ~ 



(21.182) 



Applying the definition of gradients, it follows that the proper expression for the deriva- 
tive of s with respect to allowable increments in position must be given by 



dx ^dxJ 



When applied to Eq. (21.176) this formula gives 

ds _ vi + e ^2 
dx 1 + e 2s 

and when applied to Eq. (21.177), it gives 

ds _ vi + e Jh. 
dx 1 + e 2s 



(21.183) 



(21.184) 



(21.185) 
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The above two results are identical — the paradox has been resolved! This unique result 
should be used whenever the derivative of s with respect to x is needed. Using this 
expression for the derivative also leads to intuitive results for chain rule applications. For 
example, the chain rule tells us that 

dx dx ds ,_,. .„„. 

-f = — — (21.186) 

dx ds dx 

Substituting Eqs. (21.183) and (21.184) into the right hand side leads to 

^ = P (21.187) 

dx 

Thus, for this case of constrained increments dx* , the derivative of x with respect to 
itself is not the identity tensor — it is the projection operator that takes you to the space of 
allowable increments in x. For allowable increments (dx)* , the projector has the prop- 
erty 

P»(dx)* = (dx)* (21.188) 

Thus, the projection operator is the identity tensor along the space curve! 

Another way of looking at this issue is to define a variable f=x 2 - e x ' so that the 
actual curve of interest corresponds to f = . The advantage of this approach is outlined 
in general below. 

Suppose you are given s = s(x) where x is constrained such that it satisfies 
f(x) = for some constraint function/ Then you have two equations that must be satis- 
fied simultaneously: 

(ds\* 
ds = g • dx , where g = I— I , and (21.189) 

df=h»dx = 0, where h = -f-e. (21.190) 

dx~ l 

The second equation tells us that dx = dx - hh • dx , where h = h/ Jh • h . This leads to 
the general formula for a constrained gradient: 

ds „ 

T = g '£> 

dx 

where P = I-hh,g = (-f) , h = -f-e t , and h = -p±= (21.191) 



dx> ' ~ dx 



4¥*~h 



This formula extends similarly for dependent and independent variables of any tensor 
order. It also extends to the case of multiple constraints. One serious issue with this for- 
mula relates to the possibility that h might turn out to be zero. If the constraint is /=0 , 
then a perfectly legitimate and equivalent alternative constraint would be /* =f- = . 
When using f* instead of f, the vector h* = -j-e. = 2fh would turn out to be zero within the 
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constrained space, and the above formula would break down because it would not be pos- 
sible to compute a unit vector in the direction of h* . For this reason, it's important to use 
a careful procedural means of determining the projector P that converts an arbitrary incre- 
ment into an admissible increment. 

A more physically significant example. In materials modeling, tensors are frequently 
symmetric. The projection operator that transforms any tensor into its symmetric part is 
given by 

^ = 5(8<*8,/ + M/*) ( 21 - 192 ) 

For nonlinear elasticity, the stress tensor a is taken to be a function of the strain tensor 
e mn ■ I n ra *- e f° rm > nonlinear elasticity is therefore of the form 

<*pq = E P qmn & mn (21.193) 

where the tangent stiffness tensor is defined 

E = — 22 (21.194) 

Ub mn 

Even though e mn = e nm , it is not automatically true that E pqmn = E pqnm . You have to 
force this property to hold by imposing the constrained increment projector onto this nom- 
inal derivative. 

Because the strain tensor is symmetric, the tangent stiffness tensor can {and should) be 
replaced by 

E = { ER\psym (21.195) 

U 

Doing this will ensure consistent results for derivatives, and you won't end up with patho- 
logical problems similar to those seen in the previous section. This is an extremely impor- 
tant (and poorly attended to) concept. 



* To convince yourself of this assertion, consider the very simple stress-strain relationship 
tr, = as . . , where a is a constant. Direct differentiation would give the nominal result 
E ijmn = a ^hJ>j,i - which does not satisfy E p = E pqnm . Minor symmetry must be imposed after 



the nominal differentiation to obtain £,,„,„ = ^(5, m 8 „ + 5, n 8 m ) . 



pq '"H 
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Series expansion of a nonlinear vector function 

The concept of expanding a nonlinear vector function as a series expansion is so useful 
that we will now close this book with it. In undergraduate calculus, the expansion of a 
function of one variable f(x) about a point x Q is given as 

fa) =Ax o )+f(x o )(x-x o ) + j/'(x o )(x-x o f + y'"(x o )(x-x o )^ + ... (21.196) 

Now consider a function of two variables, f(x, y) . The expansion of this function 
about the point (x , y ) is given by 

f(x,y)=f+f x (x-x o ) + ^fo x (x-x o ^ 

J y \j Jo* o y yy ^y y O' 
+ jfi y {x-x ){y-y ) 

+ Yfi x (y-y )(x-Xo) + ■■■ (21-197) 



where 



f° = ^ *' y) evaluated at (x, y) = (x ,y ) 
f° y = ^ Xy y ' evaluated at (x, y) = (x ,y ) 

fix = J, evaluated at (x,y) = (x ,y ) 

ox z 

f° yy = ~ { evaluated at (x,y) = (x ,y ) 

oy L 

fly = gg evaluated at (x,y) = (x ,y ) 

f% = 8 d 2 ^ X,y) evaluated at (x,y) = (x o ,y o ) = f° x 



(21.198) 



Note that the expansion is similar in structure to the expansion of a function of a single 
variable except that there is one derivative of every order for every possible number of 
ways to select the differentiation variables. Even though f° = f° , this mixed partial 
derivative still counts twice in the expansion. 

Now consider a field variable fix) . The vector x has three components, so this is a 
function of three variables. In direct notation, the expansion of this field variable about a 
point x o is 

f(x)=f +l •(x-X o ) + ^(x-X o )»r»(x-X o )+... (21.199) 

where 
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f = J ~' = -r^-e. evaluated at x = x 
-° dx dxf 

f = < LM1 = <LL— ee evaluated at x = x (21.200) 

:» dxdx OXjOXjJ 

~ ~ l J 

In Eq. (21.199) the first order derivative f is a vector and it appears in a vector inner 
product with (x - x ) . The second-order derivative f is a second-order tensor, and it is 
dotted from both sides by (x-x ) , which is the same thing as taking the second-order 
tensor inner product 

f':[(x-x o )®(x-x o )] (21.201) 

Following along with this pattern, the next term in Eq. (21.199) would be 

lf"\ [(x-x )®(x-x )®(x-x )], (21.202) 

where I would denote the third-order tensor inner product* so that the component form of 
the above expression would be 



iay 



3 ! dx j dx-dx k 



[(*,. - xf)(Xj-xf)(x k - 4)] (21 .203) 



In this case, the component form is clearer than the direct structural form, so it is a better 
choice in publications, especially given that the triple dot notation is highly nonstandard 
and might only confuse your readers. Alternatively, you can define a "*" operator to 
denote the inner product appropriate to the tensor order of the quantity to the right of the 
operator. Then the series expansion can be written 

/( * } = Z ^j[/*(*o)]*(*-*o) A "' < 21 - 204 ) 

n = 
where f\x o ) is an n th order tensor equal to the « th derivative of/ with respect to x, 
evaluated at x , and {x-x o ) A " denotes •^-•x , multiplied dyadically by itself n times. 
This formula generalizes to f being an arbitrary order tensor if the derivatives are back- 
ward derivatives. 



* Clearly, indicating the order of the inner product by the number of "stacked dots" could lead to 
some very weird notation for higher order tensors. You have seen the notation :: used for the 
fourth-order inner product. A circled number can always be used for higher order inner products. 
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Exact differentials of one variable 

Consider the expression typically given in undergraduate textbooks for the increment 
in work W required for a force F to act through a distance dx . 

dW = Fdx (21.205) 

This is very unfortunate notation. Notationally, in order for this to be true, the force must 
be given by 

dW 
F = — (21.206) 

dx 

which is not always true. The very act of writing this derivative implies that W really can 
be written as a proper single-valued function of x , but that's only true if the force is "con- 
servative." For frictional forces, simply knowing where you are (i.e., knowing x) is not 
enough to determine the work — you have to know how you got there. If, for example, 
you know that x=2 , then what is the work? Pushing a frictional block directly from x=0 
to x=2 will require a different amount of work than pushing it from x=0 to x=4 , and then 
finally to x=2 . For friction, the force depends on the direction of motion, not the position 
of the block. 

Even if you are dealing with a physical quantity that changes whenever x changes, 
that does not make it a function of x . If you want to define work to equal the integral of 
Fdx , then the only way you can actually evaluate the integral is if F is a function of x . In 
general, you will have to define work to be a path dependent quantity equal to the time 
integral of Fxdt . An example of a conservative force in one dimension is a simple spring. 
A linear spring is governed by F = kx and therefore the work is \kx 2 . When you stretch 
a spring, it takes positive work on the outbound leg (you must apply a force in the same 
direction as you are moving), but you gain that work back on the return trip (the force 
points in the opposite direction of motion — that is, the spring helps pull you back on the 
return trip). 

The symbol dW really should be used only for exact differentials. The expression 
Fdx is not generally an exact differential. Consider any given time history, or "path" p , 
for x . Then the work associated with the path should be defined 



W(t 2 ;p)-W(t x \p) = [Fxdt (21.207) 



where x = dx/ dt . We've inserted reference to the path p to emphasize that, in general, the 
values you obtain for the work will depend on the nature of the path itself, not just on the 
endpoints. In particular, if the path for x begins and ends at the same position, the work 
required to move the position around this closed path might not be zero: 



f 



Fdx * (21 .208) 
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Nonzero work for a closed path will occur, for example, when you push a block a certain 
distance along your desk and then back again. Because your desk has friction, you will 
have to exert work both on the outbound path and on the return. In this case, rather than 
typesetting the work increment as dW , you should explicitly call out this path dependence 
by writing it as ctW. The slash through the "d" tells your readers that information about 
the entire path (not just endpoints) would have to be provided to integrate this work incre- 
ment. 

For Fdx to be an exact differential, you must have 

&Fdx = for all closed paths in x (21 .209) 

If the force satisfies this constraint, then it is called a "conservative" force field, and it is 
legitimate to write dW for the associated work increment. In this case we are permitted to 
write dW = Fdx . To summarize 

F = — for conservative forces (21.210) 

dx 

Exact differentials of two variables 

Consider the expression 

f(x, y)dx + g(x, y)dy (21.211) 

Is this an exact differential? In other words, does there exist a potential function u(x,y) 
such that 

du = f{x, y)dx + g(x, y)dy (21.212) 

If such a potential function exists, then the chain rule demands that we should be able to 
write 

du , du , 
du = —dx + —dy (21.213) 

ox dy 

Comparing coefficients of dx and dy in Eqs. (21.211) and (21.213) shows that a neces- 
sary condition for existence of the potential is 

^■=f(x,y) and f* = g(x,y) (21.214) 

ox dy 

The potential exists if this set of equations can be integrated. A necessary and sufficient 
condition for existence of u is 

(21.215) 





d 2 u _ d 2 u 




dxdy dydx 


or 






df = dg 

dy dx 



(21.216) 
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If this is true, then the system in Eq. (21.214) has a solution. Otherwise, the expression 
fdx + gdy is inexact. 

The same result in a different notation. Instead of using the distinct symbols f and g, 
let's replace / by f x and g by f 2 . Let's also replace x and y by x x and x 2 , respectively. 
Then the above results can be written as follows: 

f l dx l +f 1 dx 2 (21.217) 

is an exact differential if and only if 

3/i df 2 

— = — (21.218) 

dx 2 dx x 

We can define a matrix //■■ = df t /dx: , where the indices range from 1 to 2. Then the con- 
straint of Eq. (21.218) requires that this matrix must be symmetric. If it is, then there exists 
a potential such that 

du = f l dx l +f 2 dx 2 (21.219) 

The potential is found by integrating 

fi = lr (21220) 

ox t 
This system of two equations has a solution if the matrix //■■ = df/dx- is symmetric. 

Exact differentials in three dimensions 

Under what conditions does there exist a potential u(x v x 2 , x 3 ) such that 

du = f\dx x +f 2 dx 2 +f 3 dx 3 (21 .221 ) 

where the f k are each functions of x x , x 2 , and x 3 . A necessary condition for the potential 
to exist is 

f. = — (21.222) 

5x- 

A sufficient condition for the existence of the potential is 

d 2 u d 2 u 

dXjdXj dxfix: 
1 j j ' 

or 



(21.223) 



— = -^ (21.224) 

dXj dx ; 
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In other words, the matrix, 

H l} = -^ (21.225) 

where now the indices range from 1 to 3, must be symmetric. 

Coupled inexact differentials 

Consider a vector y that is a proper function of another vector x . Then 

dy i 
dy ' = dx~ dX J (21226) 

or 

' ' ' ' (21 .227) 



J l IJ J' 


U 8x j 


Note that 




d 2 y t _ d 2 y t 

dx:dx k dx k dx- 




and therefore 




sc tJ _ ec lk 

dx k dxj 





(21.228) 



(21.229) 

Now consider the inverse question. Given a tensor C- that varies with x , under what con- 
ditions will it be true that there exists a field y such that 

C, y = ^ (21.230) 

The field y will exist if and only if Eq. (21.229) is true. 

This result has an elegant application in elasticity theory. For large deformations, the 
deformation gradient tensor is defined 

ox 
F ; - = — - (21.231) 

lJ 8Xj 

Given only a candidate spatially varying field F- , this field corresponds to a physically 
realizable deformation if and only if 

dF u dF ik 

iZ = «* (21.232) 

3X k dXj 
Consider, for example, 
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[F] 



x 2 

1 
1 



Then 



dFu 

dX 



but 



dF 



12 



dX l 



Therefore, this is not a physically realizable deformation. 



22. Vector/tensor Integral calculus 



Gauss theorems 



Stokes theorem 



Divergence theorem 



(21.233) 



(21.234) 



(21.235) 



Integration by parts 

In scalar calculus, the chain rule for differentiating a product is 

d(uv) __ dv du 
dx dx dx 

Integrating both sides with respect to x varying from a to b gives 

b 



• d(uv) 
dx 



dx 



b b 

r dv , , r du 

u—dx+ v— 

J dx J dx 



dx 



(22.1) 



(22.2) 



The left-hand-side is simply uv\ . Thus, the above result can be written 



c dv , ,t r du , 

\u—dx = uv\ - v— ax. 
J dx lfl J dx 



(22.3) 
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which is the formula for integration by parts. Note that 

uv\ = uv\, - uv\ (22.4) 

la >b >a 

We can regard the one dimensional domain to be a uniaxial bar with outward normal 
n = 1 at x = b and « = -1 ati = a. Then the above expression may be written 

(22.5) 



uv\ = 

la 


nuv\, + 

>b 


nuv\ 

la 






and therefore integratior 


i by parts 


becomes 


b 






b 




\u—dx 
■> dx 


= nuv\ 


, + nuv\ 

la 


r du , 
- v— dx , 
J dx 


a 






a 





(22.6) 



Now let's generalize integration by parts for tensors. Suppose that, during your research, 
you encounter an integral of the form 

f f f U ' VvrfK (22.7) 

v 
The integrand is a lot like the expression udv/dx just discussed in the ID context, but 
now you have a volume integral containing a gradient operation. You might hope to apply 
one of the Gauss theorems to convert it to a surface integral. Unfortunately, however, 
Gauss's theorems require that the gradient operator must act on the entire integrand, not 
just part of it. You can move partially in the desired direction by using the product rule to 
write the integrand differently: 

d v k duv, du 
[* • V*]* =U -df m = -8x~- Vk df m = [V * fe) " V ~ ( V ' t )]k (2Z8) 

This equation, which is the analog of Eq. (22.1), permits the volume integral of interest to 
be written 

JJ j"a • VvdV = J JJ V • (uv)dV- J J Jv(V • u)dV (22.9) 

V V V 

The first integrand on the right-hand-side is now of the form required for application of 
Gauss's theorem, so it can be converted to a surface integral: 

JJJm • VvdV = j"j"« • (uy)dS- |J|v(V • u)dV (22.10) 

V S V 

This is the generalization of integration by parts. Note the similarity of this result with the 
ID formula in Eq. (22.6). This basic process may be applied to integrands of various struc- 
tures. Specifically, if your integrand involves a gradient, you can apply the product rule to 
make the gradient act across the entire integrand, subtracting appropriate terms. Then a 
Gauss theorem applies to the gradient term, converting it to a surface integral. 
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Leibniz* theorem 

The Leibniz formula, 

6(0 6(0 

f t \A*.t)dx= jf 3 ^* +mt) , t) fn_ f(a{tlt) djm ( 22.ii) 

a(t) a(t) 

is typically given lower-class status in applied math textbooks. It appears only as a foot- 
note in Ref [36] and as part of a homework question in Ref [1]. Though elementary, this 
is a profoundly useful formula in its own right and especially in its generalization to higher 
dimensions. 

Let's first understand the Leibniz formula in the ID form cited in Eq. (22.11). What is 
this equation trying to say? Why should we care? Looking at the left-hand-side of Eq. 
(22.1 1) shows that this is a formula for taking the time derivative of an integral where both 
the integrand and the integration limits vary with time. The variable t doesn't have to be 
time — it can be any scalar, but we will discuss it using the name "time" for t and the 
name "position" for x . When written with the arguments of the functions being under- 
stood, and letting total differentiation by time be denoted with a superimposed "dot", Eq. 
(22.11) takes a cleaner look: 

b b 

ljf dx = jf t dx + f b b-f a a (22.12) 

a a 

Here, f a and f b denote the function evaluated at x=a and x=b , respectively. The symbols 
a and b represent the velocities of the boundary. The integral on the left-hand side repre- 
sents the area under the curve fix) at some particular moment in time. The right-hand-side 
tells us that this area can change in two possible ways: you can change the function itself 
(so f{x) is really fix, t) ) or you can change the limits of integration. This equation tells us 
you can't simply bring the total time derivative inside the integral — movement of the 
boundary must be accounted for. Also note that a total derivative "d" is used on the left- 
hand side, but a partial derivative is used once the derivative is "passed inside" the inte- 



Note: this word is not spelled "Leibnitz". Even though there's no "T", it should be pronounced as if 
it were spelled with one. Reference [36], which is written for engineers, gets it wrong but Reference 
[1], for physicists, gets it right. It's another embarrassing day for us engineers. 



288 

Copyright is reserved. Individual copies may be made for personal use. No part of this document may be reproduced for profit. 



September 4, 2003 5:24 pm 
Vector/tensor Integral calculus 



gral. That's because the function / depends on both x and t , but the area depends only on 
t . Now, what about those boundary terms? Why is there a negative sign in front of the 
term for the left boundary, but no negative for right boundary? A picture tells it all. Sup- 
pose you are looking at the profile of a mountain through the window of an airplane: 




The window 
is losing this 
area sliver. 




The window 
is gaining this 
area sliver. 



ddt 



Only a portion of the mountain shows through your window, and you naturally 
observe that the visible area changes with time. The mountain itself isn't (we hope) mov- 
ing, so df/dt . The visible area is changing simply because the boundary is moving. In this 
example, the leading edge is moving at the same speed as the trailing edge. From the pic- 
ture, it's clear that you are gaining area on the leading edge (new area is "flowing" into the 
window). The incremental change in area equals the height of the function there, f b , times 
the width bdt . You are losing area (negative area rate) on the trailing edge with an area 
increment f a ddt* In the limit, the rate of area is determined by the flux of the function 
across the boundary. Of course, if the mountain were simultaneously sinking into the 
ocean, then you would see area changes from interior contributions to the area integral 
captured through the df/dt term. 

Another way to deal with the sign of the flux (and a key to generalizing Leibniz's for- 
mula to higher dimensions) is to introduce the outward-pointing normal to the boundary: 



»* = -! 



outward unit normal at x=a 



n b = +1 = outward unit normal at x=b 
Then the ID Leibniz formula would read 



(22.13) 
(22.14) 



Jt\ fdX = \{ t dx+f b n b b+ fa n a & 



(22.15) 



In this form, there is no negative. Each boundary term is the value of the function at that 
boundary location times the product of the boundary velocity times the outward normal. 

The generalization of the Leibniz formula to 3D is 



| \ flx, t)dV = J f^-V+ \ f(x, t)(n 



• v 



,)dS 



n(0 



n(0 



dCl(t) 



(22.16) 



* If the airplane were ascending or descending, you would have additional changes in area from the 
bottom and top edges of the window frame, but that would make this a two-dimensional problem, 
so we will assume the plane is cruising at a constant altitude. 
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Note the similarity between this equation and its ID counterpart, Eq. (22.15). Here, Q is a 
volume whose shape is varying in time. The integral over dV is a volume integral and the 
integral over dS is a surface integral over the time-varying boundary dQ. . The vector y b 
is the velocity of the boundary and the integrand of the surface integral is the net flux of 
the function f into the integral resulting from motion of the boundary. Of course outflow 
occurs if the boundary velocity is encroaching on the interior of Q. , which would be 
accounted for automatically because the boundary velocity y b would have a negative dot 
product with the outward unit normal n . Tangential components of the boundary velocity 
have no influence on the rate of the integral. 

For the generalized Leibniz formula to make sense, you must do a good job of specify- 
ing the velocity of the boundary everywhere. Continuum mechanics (and thermodynam- 
ics) theory typically deals with two types of "control volumes." An Eulerian control 
volume is fixed in space so that v, = and 



\f{x, t)dv = J d/te '\ i V fo r Eulerian control volumes (22.1 7) 



Because an Eulerian control volume is fixed in space, material (and any properties it might 
carry such as density and polarization) will flux through the boundary (note that we 
changed Q.(t) to simply Q). A Lagrangean* control volume, on the other hand, is 
defined to always contain the same material particles, so its velocity equals the material 
velocity, y b =v , and therefore the 3D Leibniz formula for this type of control volume is 

j j* f(x,t)dv = J 8 -^-' f W + j* f(x,t)(n»v)ds for Lagrangean control volumes (22.18) 

O(t) £1(0 80(0 

This form of the Leibniz formula is called Reynolds ' transport theorem. The only differ- 
ence between Eqs. (22.17) and (22.18) is the motion of the boundary, which shows just 
how crucial it is for you to be extremely diligent to be clear about which viewpoint you are 
using. Many theorists prefer to apply all of their integral equations to Lagrangean control 
volumes — this makes a lot of sense because the most fundamental statements of physical 
principals are often the most elegant when applied to a specific set of particles. For exam- 
ple, Lagrangean conservation of mass states that the total mass of a specific set of particles 
must not change? and Newtonian mechanics tells us that the net force on a specific set of 
particles must equal the rate of change of the momentum. People who tend to use 
Lagrangean control volumes can spare themselves the trouble of constantly reminding 
their readers that their control volumes move with the material by using the material deriv- 



* The spelling of this word is yet another subject of debate among the cognoscenti. "Lagrangean" 
appears better justified from the historical record and from rules of orthography, but so many peo- 
ple use "Lagrangian" that this might be a losing battle. 

t Here we go again: It's Reynolds, not Reynold's (each undergraduate's bane). 

J Before the nuclear engineers out there go ballistic and remind us that E - mc 2 tells us that mass 
can be annihilated by converting it to energy, just keep in mind that conservation of mass just a 
principle, not a law. 



290 

Copyright is reserved. Individual copies may be made for personal use. No part of this document may be reproduced for profit. 



September 4, 2003 5:24 pm 
Vector/tensor Integral calculus 



ative symbol, D( )/Dt, to tell their readers that this is a time derivative in which the 
material particles are being followed. When using this notation, showing the explicit time 
dependence in Q.(t) is not necessary because using "D" instead of "d" implies the time 
dependence. Thus, you might see Reynolds transport written as 



£j/(x, t)dV = \^ 1 dV + I f(x, t)(n . v)dS (22.1 9) 

n n an 

The phrase "for Lagrangean control volumes" is no longer needed because it's implied by 
the use of "D." 

LONG EXAMPLE: conservation of mass. In Eulerian form, the principle of conserva- 
tion of mass says, in essence, 

What goes in must come out — or stay there. (22.20) 

The first part (what goes in must come out) is referring to flux of mass across the fixed 
Eulerian boundary. The second part is referring to the fact that mass can simply accumu- 
late inside the control volume (neither coming in nor going out). In rate form, the Eulerian 
statement of conservation of mass is 

The rate of accumulation must equal the rate of influx (22 .2 1 ) 

or 

The rate of accumulation minus the rate of influx must equal zero (22.22) 

Letting stuff going in be regarded as a negative contribution to stuff coming out, the state- 
ment could alternatively read 

The rate of accumulation plus the rate of OUTflow must equal zero (22.23) 

Since mass equals density p times volume, this Eulerian statement of mass conservation 
may be written mathematically as 



\pdv+ J p(n»v)ds = o for Eulerian control volumes (22.24) 



d_ 

dt 
o. en 



The first term measures the rate of mass accumulation and the second term measures the 
rate of outflow. Since this is an Eulerian control volume, you can use Eq. (22.17) "inside" 
the integral to write 

\j- t dv+ jp(vv)dS = (22.25) 

n sn 

Now consider how the analysis of conservation of mass would go from a Lagrangean per- 
spective. If we are considering a fixed set of particles, conservation of mass merely says 
that the total mass of those particles must not change. In rate form, that means 

§- f \pdV=0 (22.26) 

or, using Eq. (22.19), 

\j- dv+ | P(3 * v ~) ds = ° (22.27) 

n en 
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Note that this Lagrangean result is identical to Eq. (22.25) which was derived using an 
Eulerian perspective. Importantly, once a derivative has been brought inside of an integral, 
the nature of the boundary (Lagrangean, Eulerian, or otherwise) becomes inconsequential. 
Now that the derivative is inside the spatial integral, both equations give the same result if 
evaluated over the same region in space. The fact that those regions might no longer coin- 
cide at some time in the future has no bearing on what's going on now. 

Incidentally, by using the divergence theorem, the surface integral may be converted to 
a volume integral. To do this, keep in mind that the unit normal becomes a "nabla" gradi- 
ent operator that acts on everything else in the integrand. Thus, p(« • v) will not become 
pV • v . Instead, it will become V • (pv) . Of course, don't forget to change the dQ. to an 
Q, and the dS to a dV to obtain 

\ 8 ~dt dV+ J^ * (pvJdV = ° (22.28) 



dt 
n 



}(f + V.(pv))^=0 (22.29) 



or 



The differential form of conservation of mass (often called the continuity equation) is 
obtained by asserting that this integral equation must be true regardless of what region of 
space we choose to use as a control volume. The only way that can be true is if the inte- 
grand itself is zero: 

^£ + V • (pv) = (22.30) 

dt 

In this equation, the time derivative holds the spatial position x fixed and the gradient is a 
derivative with respect to x holding time constant. To make this point more explicit, you 
might see the partial derivative being written more carefully with a subscript that 
describes precisely what is being held fixed: 



(22.31) 

The fact that the time derivative holds the spatial position fixed makes this form of 
conservation of mass particularly appealing to people with an Eulerian mindset. An Eule- 
rian observer plants his you-know-what in a single location and watches how things 
change in front of him. He will be looking at the densities of various particles at the instant 
they pass by his fixed location. This perspective is unsavory to folks with a Lagrangean 
mind-set. 

Lagrangean people prefer to talk about how properties of a single-particle of interest 
change over time. Of course, to do that, they will have to obligingly move themselves with 
the particle, keeping it always under their watchful eye. To describe the Lagrangean time 
derivative, we need to introduce a variable X whose value will never change for any given 
particle. Furthermore, distinct particles need to have distinct values of X so that X can, in 
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a sense, be regarded as a unique identifier or "name" for any particle in much the same 
way that x uniquely defines a particular location in space. A natural choice for X is sim- 
ply the initial location of a particle. The uniqueness requirement is satisfied because no 
two particles will have occupied the same initial location in space* The requirement that 
X not vary in time is satisfied because, naturally, the initial location of a particle is time- 
independent. Now we are in a position to define the substantial derivative or material 
derivative of any field variable O as 

bfHsFJ* <22 ' 32) 

Since X is being held constant, and since X uniquely identifies a particular particle this 
expression is the time derivative of O as seen by an observer who is moving with the par- 
ticle — it is the Lagrangean time derivative! 

What is the connection between what a Lagrangean and Eulerian observers see? The 
answer comes from the chain rule: 

In the last term, (dx/dt) x holds X constant, so it is the rate at which the Lagrangian 
observer sees the spatial locations change. You might be wrongly tempted to think that, if 
the observer is moving to the right, then he sees the material beneath him moving to the 
left, but you have to interpret the derivative (dx/dt) x literally. If for example, the 
Lagrangean observer moves from x = to x = 4 over some period of time, he sees that 
x has increased. Thus, even though the spatial grid appears to be moving to his left, the 
values on the grid are increasing. The rate of increase is exactly equal to the velocity of the 
observer. Since Lagrangean observers move with the material, this means that 

Tf = v, the material velocity! (22.34) 

\dtJ x ~ 

Thus, the material derivative becomes 

You will frequently see this result presented more cryptically as 
Dt ot 



* Actually, this is not quite true from a mathematical perspective — if a material fractures, then a par- 
ticle that started out at a particular location will "break" into separate locations. There are ways 
around this issues. For the discussion at hand, though, let's assume no fracture. 
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and it will be up to you to keep in mind that every term involves partial derivatives, which 
can make physical sense only if you vigilantly remind yourself what is being held constant 
in those derivatives. Using this result in Eq. (22.30) permits us to now write the continuity 
equation as 

— " (Vp) • v + V • (pv) = (22.37) 

Using the product rule on the last term leads to a cancellation of the middle term, giving 

— + P(V« v) = 



Contrast this with Eq. (22.31). They are both the same result, with one presented using the 
Eulerian time derivative and the other using the Lagrangean material derivative. Note also 
that one equation has the density field inside the divergence operator, while the other 
doesn't. 

Yet another notational convenience is in common use: for any field variable O , 

O means the same thing as — — (22.39) 

Using this convention, Eq. (22.38) can be written 

2 = V • v (22.40) 

P 

For continuum mechanics researchers, this is a very appealing result because numerical 

material models typically have access to the velocity gradient tensor, typically 

denoted by L , and defined 

IsvV.orL, = — i (22.41) 

- - * dXj 

Note that 

trZ, = v« V = V«v (22.42) 

and therefore, the continuity equation can be written in yet another form 

2 = trZ, (22.43) 

P 

Finally, since the trace operation depends only on the diagonal components, this result is 
often written 

2 = trZ), where D = -(L + L T ) = sym(L) (22.44) 

p « 2 " " ' ' * 

The tensor D is often called the "rate" of deformation even though it is not a true rate. 
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Generalized integral formulas for discontinuous integrands 

All of the integral formulas cited so far require the integrand to be differentiable. What 
can you do if the integrand is differentiable everywhere except across a singular "jump" 
surface, like what you have in shock physics? The answer is to first break up the surface 
integrals into two separate parts over each differentiable domain. However, doing this will 
break a formerly closed surface into the union of two open surfaces. Before you can apply 
the divergence theorem, you will need to close the surfaces, this time along the shared 
boundary defining the discontinuity. This is the basic flavor of dealing with discontinuous 
integrands. Now let's get into the details. 
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"The ability to quote is a serviceable substitute 
for wit. " — W. Somerset Maugham 

^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 

23. Closing remarks 

This book has provided an introduction to vector and tensor concepts, as well as some 
very advanced forays into more obscure topics such as projections (in ordinary engineer- 
ing space, as well as higher dimensional spaces), the concept that a tensor is also a vector, 
the notion of right and left gradient operations, and generalizations of hallowed integral 
theorems permitting application to discontinuous integrands (as in shock physics). 

A key goal of this book was to call out a distinction between the functional, engineer- 
ing, and structural perspectives on tensor analysis. You can't have one without the other. 
The functional meaning of a tensor is a linear transformation from vectors to vectors. This 
statement does not make sense unless the term "vector" is defined and, for engineering 
applications, this necessarily requires discussing of how vector components transform 
upon a change in basis. Finally, the structural perspective of tensor analysis deals exclu- 
sively for the arrangement of symbols that we write down on a page to represent the func- 
tional meaning of a tensor. The structures themselves are often referred to as tensors, and 
there is nothing wrong with that. In this book, we outlined a structural self-consistent ten- 
sor nomenclature that is well-poised for moving smoothly into higher dimensions, but we 
are not intending to suggest that our structure is "the best." There is no best tensor struc- 
ture. Granted there are some bad ones out there that aren't self-consistent, but lots of folks 
use alternative notations that are adequate and often superior for their applications. 

This book is by no means a comprehensive discourse. Our goal here was to emphasize 
theorems and concepts that are useful in mechanics, especially in the higher dimensional 
applications that come up in materials modeling. We have omitted many classic discus- 
sions (such as formulas for gradient operations in curvilinear systems) that are very stan- 
dardized and available in almost any textbook on vector and tensor analysis. We only 
mentioned classic operations and concepts when (a) they were needed for completeness of 
later, less classic, discussions that we will publish elsewhere or (b) we had non-traditional 
insights to offer. 

This book should be regarded as a "zeroth" or "beta" edition. As such it is highly 
likely that it still contains errors and typos. Readers are encouraged to send feedback and 
corrections to rmbrann@mo.unm.odu^ 
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24. Solved problems 

This chapter is brand-new and totally disorganized. It 
will take a few more seasons to get it up to speed. Sorry. 
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